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DESCRIPTION 

APPARATUS AND METHOD FOR PHOTOGRAPHING THREE-DIMENSIONAL IMAGE, 
APPARATUS AND METHOD FOR DISPLAYING THREE-DIMENSIONAL IMAGE, AND 
5 APPARATUS AND METHOD FOR CONVERTING THREE-DIMENSIONAL IMAGE 
DISPLAY POSITION 

TECHNICAL FIELD 

HI The present invention relates to an apparatus and method 

Pi 10 for photographing a three-dimensional image for acquiring image 

m 

CO information required for displaying a three-dimensional image 

(stereoscopic image) of an object in a space, and an apparatus 
and method for displaying a three-dimensional image to display 
a three-dimensional image of an object in a space by projecting 
15 a plurality of pieces of two-dimensional image information of an 
object obtained by viewing the object in different viewing 
directions, in directions associated with the respective viewing 
directions. The present invention also relates to an apparatus 
and method for converting a display position of a three- 
20 dimensional image which is used in a system for displaying a 
three-dimensional image of an object in a space by projecting a 
plurality of pieces of two-dimensional image information on the 
object obtained by viewing the object in different viewing 
directions, in directions associated with the respective viewing 
25 directions, and which convert the position of the three- 
dimensional image of the object displayed in the space. 
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Various proposals have recently been made on techniques 
for displaying a stereoscopic image as a result of the progress 
5 of optical technologies . One of such techniques is two -glass type 
three-dimensional viewers such as IMAX THEATER (trademark) 
capable of presenting stereoscopic display to a user who wears 
dedicated eyeglasses to see an image formed by an image for the 
left eye and an image for the right eye in an overlapping 
10 relationship. This apparatus enables to present stereoscopic 
display in the form of a stereogram utilizing parallax between 
left and right eyes. 

3 

Pi Stereoscopic display is also performed with holography 

f a j utilizing coherent light from a laser or the like. This technique 

£?? 

p 15 is to display a stereoscopic image by forming a hologram on a dry 

U 

plate or the like using object light and reference light in advance 

and by irradiating the hologram with the original reference light 

to obtain reproduction light. 

Techniques for displaying a stereoscopic image without any 
20 need for dedicated eyeglasses include the so-called IP (integral 

photography) method, and the parallax method. 

The IP method was proposed by Lippmann . A photographic dry 

plate is provided on a focal surface of a lens plate called "fly- eye 

lens" constituted by a multiplicity of small convex lenses; the 
25 photographic dry plate is exposed to object light through the lens 

plate to record a multiplicity of small object images thereon; 



3 

and the photographic dry plate is thereafter developed, placed 
i n exactly the same position as its initial position and irradiated 
with light on the back surface thereof. 

The parallax method is a method in which strip- shaped images 
5 respectively associated with left and right eyes are separately 
viewed through apertures in the form of vertical grills placed 
in front of the strip- shaped images. 

Among the above techniques, the above -described 
stereoscopic viewers are inconvenient for a viewer because he or 

10 she must wear dedicated eyeglasses and are not suitable for 
observation for a long time because they present unnatural images 
which are likely to give fatigue. 

The above -described technique for presenting stereoscopic 
display utilizing holography involves a large scale apparatus at 

15 a high manufacturing cost because of the requirement for coherent 
light from a laser or the like and also results in a reduction 
of image quality attributable to speckle interference patterns 
which are characteristic of lasers. Further, holography is 
suitable for still images but unsuitable for three-dimensional 

20 display of dynamic images because it presents stereoscopic 
display of an object utilizing a hologram formed on a photographic 
dry plate in advance. This equally applies to the above- described 
IP method in that it is unsuitable for dynamic images because it 
involves a step of recording a multiplicity of small object images 

25 on a photographic dry plate in advance. 

The parallax method that requires no dedicated eyeglasses 
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only presents pseudo-stereoscopic display utilizing parallax 
between left T-inht eyes and does not allow three-dimensional 
display in a true sense. Therefore, although an image can be 
represented with a stereoscopic sense in the horizontal direction 
5 of a screen, it cannot be represented with a stereoscopic sense 
in the vertical direction and, for example, cannot be viewed by 
a person who is lying down. Further, since it is a technique 
utilizing parallax, a change of a view point only results in a 
view of the same image with a stereographic sense (a sense of depth) , 

10 and a side of an object will not appear even if the viewer moves 
the head to look at the object from left and right sides thereof. 

Further, in order to implement the parallax method, an 
object must be photographed in different directions with a 
plurality of cameras; the films photographed by the cameras must 

15 be developed; and the films must be printed on photographic paper 
through apertures with a plurality of image projectors to form 
strip-shaped images. Therefore, a large scale apparatus is 
required to implement the parallax method. 



20 it is difficult to achieve display of a stereoscopic dynamic image 
in a true sense with a simple configuration. 

Any of the conventional techniques for stereoscopic 
display only allows a three-dimensional image to be displayed in 



25 techniques for stereoscopic display have low rendering capability 
in that it is difficult to achieve a representation in which a 



As thus described, according to conventional techniques 



a predetermined position. 



Therefore , the convent ional 



three-dimensional image is moved toward or away from the viewer, 

fur . 

DISCLOSURE OF THE INVENTION 
5 The present invention has been made taking such problems 

into consideration, and it is a first object of the invention to 
provide an apparatus and method for photographing a three- 
dimensional image and an apparatus and method for displaying a 
three-dimensional image which make it possible to acquire image 
10 information required for displaying a three-dimensional image of 
an object in a space with a simple configuration and to achieve 
r?| display of a stereoscopic dynamic image in a true sense with a 

simple configuration. 

It is a second object of the invention to provide an 
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□ 15 apparatus and method for converting the display position of a 
three-dimensional image which make it possible to convert the 
position of a three-dimensional image of an object displayed in 
a space in a system for displaying a three-dimensional image of 
an object in a space. 

20 A first three-dimensional image photographing apparatus 

of the invention is to acquire image information required for 
displaying a three-dimensional image of an object in a space. The 
apparatus has: a single photographing means for photographing an 
object to generate two-dimensional image information of the 

25 object; and photographing direction control means for 
sequentially changing the photographing direction of the 



photographing means. 

Accuj-uiny Lo the thrcc-dirp.er^T^rial imacre photographing 
apparatus, two-dimensional image information of the object is 
generated by photographing the object with the single 
5 photographing means, and the photographing direction is 
sequentially changed by the photographing direction control 
means . 

In the first three-dimensional image photographing 
□ apparatus of the invention, the photographing direction control 

fn 10 means may have deflecting means which is provided between the 

m 

W object and the photographing means and which deflects light by 

W 

kI) selecting a direction for incident light. Alternatively, the 

CO 

3 photographic direction control means may have driving means for 

y moving the photographing means; or may have driving means for 

15 moving a part of an optical system provided between the object 
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? sfc and the photographing means. 

In the first three-dimensional image photographing 
apparatus of the invention, the photographing direction control 
means may set the same photographing direction for all pixels of 

20 the two-dimensional image information and may sequentially change 
the photographing direction. Alternatively, the photographing 
direction control means may set a different photographing 
direction for each pixel of the two-dimensional image information 
and may sequentially change the photographing direction for each 

25 pixel. 

A first method for photographing a three-dimensional image 
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of the invention is a method for photographing a three-dimensional 
image tor acquiiiny image information squired for displaying a 
three-dimensional image of an object in a space. The method 
includes: a photographing step for photographing the object with 
5 a single photographing means to generate two-dimensional image 
information of the object; and a photographing direction 
controlling step for sequentially changing a photographing 
direction at the photographing step. 

□ 

According to the method, the object is photographed with 

^$ 

n\ 10 the single photographing means to generate two-dimensional image 

Ki 

yi information of the object at the photographing step, and the 

ii 

nl photographing direction at the photographing step is sequentially 

Q changed at the photographing direction controlling step. 

□ In the first method of the invention, for example, the 

□ 15 photographing direction controlling step may deflect light by 

selecting a direction for incident light between the object and 
the photographing means to thereby change the photographing 
direction. Alternatively, the step may move the photographing 
means to thereby change the photographing direction, or may move 
20 a part of an optical system provided between the object and the 
photographing means to thereby change the photographing 
direction. 

In the first method of the invention, for example, the 
photographing direction control means may set the same 
25 photographing direction for all pixels of the two-dimensional 
image information and sequentially change the photographing 
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direction. Alternatively, the photographing direction control 
means may seL a uirrercnt photograph*™ direction for each pixel 
of the two-dimensional image information and sequentially change 
the photographing direction for each pixel. 
5 A second three-dimensional image photographing apparatus 

of the invention is an apparatus for acquiring image information 
required for displaying a three-dimensional image of an object 
in a space, and it has: photographing means for photographing the 
object to generate two-dimensional image information of the 
10 object; photographing direction setting means for setting a 



CO photographing direction for the photographing means, capable of 

*£i setting a different photographing direction for each pixel of the 

CO 

s two-dimensional image information; and photographing control 

means for controlling the photographing direction setting means 

Q 

cn 15 to acquire two-dimensional image information with a low 

Q 

^ =n resolution that is lower than the resolution of the photographing 

means in every photographing direction that can be set, and for 
repeatedly performing a process of generating the two-dimensional 
image with the low resolution while changing pixels to which a 

20 specific photographing direction is assigned, to acquire two- 
dimensional information with the same resolution as the 
resolution of the photographing means in every photographing 
direction that can be set. 

According to the second three-dimensional image 

25 photographing apparatus of the invention, the photographing means 
generates two-dimensional image information of an object. The 
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photographing direction setting means is controlled by the 

. „~ ac tn acauire, in every 

photograpning coulj-uj. .»~~"~ — — 

photographing direction that can be set. two-dimensional image 
information with a low resolution that is lower than the resolution 
5 of the photographing means, and a process of generating the 
two-dimensional image information with the low resolution is 
repeatedly performed while changing pixels to which a specific 
photographing directions is assigned, to thereby acquire, in each 
of all the photographing directions that can be set. two- 
10 dimensional image information with a resolution that is the same 
as the resolution of the photographing means. 

in the second three-dimensional Image photographing 
apparatus of the invention, for example, the photographing means 
divides a two-dimensional image region into a plurality of 
15 sub-regions each having A pixels (A is an integer equal to or 
greater than 2) and sets each of all the photographing directions 
that can be set for one pixel in each of the sub-regions to acquire 
the two-dimensional image information with the low resolution 
that is 1/A of the resolution of the photographing means. The 
20 photographing means then repeats a process of generating the 
two-dimensional image information with the low resolution A times 
while changing pixels to which a specific photographing direction 
is assigned in the sub-regions, to acquire the two-dimensional 
i.age information with the same resolution as the resolution of 
25 the photographing means. In this case, for example, the 
photographing control means divides all the photographing 
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directions that can be set into groups each consisting of A 
yhuLographing direction? repeatedly performs a process of 
acquiring the two-dimensional image information with the low 
resolution in the A photographing directions, thereby acquiring 
5 the two-dimensional image information with the low resolution in 
all of the photographing directions that can be set. 

In the second three-dimensional image photographing 
apparatus of the invention, for example, the photographing 

O 

. f& directing setting means may have defecting means provided between 

CO 

P=;j 10 an object and the photographing means for deflecting incident 
CO 

(j| light by selecting a direction. 

5 
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A second method for photographing a three-dimensional 



p image according to the invention is a method for acquiring image 



Q information required for displaying a three-dimensional image of 

m 

13 15 an object in a space using: photographing means for photographing 



an object to generate two-dimensional image information of the 
object; and photographing direction setting means for setting a 
photographing direction for the photographing means, capable of 
setting a different photographing direction for each pixel of the 

20 two-dimensional image information. The method includes: a first 
step for controlling the photographing direction setting means 
to acquire, in each of all the photographing directions that can 
be set, two-dimensional image information with a low resolution 
that is lower than the resolution of the photographing means ; and 

25 a second step for repeatedly performing the first step while 
changing pixels to which a specific photographing direction is 
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assigned, to acquire two-dimensional image information with a 
resoiuLion Lhat Lz the cer?.e e.s the r ^«ni ntion of the photographing 
means in each of all the photographing directions that can be set . 
According to the method, the photographing direction 
5 setting means is controlled at the first step so as to acquire 
two-dimensional image information with a low resolution that is 
lower than the resolution of the photographing means in each of 
all the photographing directions that can be set . At the second 
step, the first step is repeatedly performed while changing the 

10 pixels to which a specific photographing direction is assigned, 
to acquire two-dimensional image information with the same 
resolution as the resolution of the photographing means in each 
of all the photographing directions that can be set. 

In the method, for example, the first step divides a 

15 two-dimensional image region into a plurality of sub-regions each 
having A pixels (A is an integer equal to or greater than 2) and 
sets each of all the photographing directions that can be set for 
one pixel in each of the sub-regions, thereby acquiring the 
two-dimensional image information with the low resolution, the 

20 low resolution being 1/A of the resolution of the photographing 
means . The second step repeatedly performs the first step A times 
while changing pixels to which a specific photographing direction 
is assigned in the sub-regions, thereby acquiring the two- 
dimensional image information with the same resolution as the 

25 resolution of the photographing means . In this case , for example , 
the first step divides all of the photographing directions that 
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can be set into groups each consisting of A photographing 
ui-i.ec Lions , and repeatedly ™*r-Forins a process of acquiring the 
two-dimensional image information with the low resolution in the 
A photographing directions, thereby acquiring two-dimensional 
5 image information with the low resolution in all of the 
photographing directions that can be set. 

A three-dimensional image display apparatus according to 
the invention is an apparatus for displaying a three-dimensional 
t n image of an object in a space by projecting a plurality of pieces 

to 

jn 10 of two-dimensional image information of the object obtained by 

HI 

(ji viewing the object in different viewing directions, in projecting 

\li 

CO directions associated with the respective viewing directions. 

□ The apparatus has: projecting means for projecting the two- 

dimensional image information of the object; projecting direction 
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□ 15 setting means for setting a projecting direction for the 
projecting means, capable of setting a different projecting 
direction for each pixel of the two-dimensional image 
information; and display control means for displaying a 
three-dimensional image with a low resolution by controlling the 
20 projecting direction setting means to project two-dimensional 
image information with a low resolution that is lower than the 
resolution of the projecting means in every projecting direction 
that can be set, and for repeatedly performing a process of 
projecting the two-dimensional image information with the low 
25 resolution while changing pixels to which a specific projecting 
direction is assigned, to display a three-dimensional image with 
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the same resolution as the resolution of the projecting means. 

AuuujLuirig to the three -dii^^n^i onal imaqe display apparatus 
of the invention, the two-dimensional image information of the 
object is projected by the projecting means. The projecting 
5 direction setting means is controlled by the display control means , 
so as to project two-dimensional image information with a low 
resolution that is lower than the resolution of the projecting 
means in every projecting direction that can be set, thereby 
displaying a three-dimensional image with a low resolution. A 

10 process of projecting the two-dimensional image information with 
the low resolution is repeatedly performed while changing pixels 
to which a specific projecting direction is assigned, to thereby 
display a three-dimensional image with a resolution that is the 
same as the resolution of the projecting means. 

15 In the three-dimensional image display apparatus of the 

invention, for example, the display control means divides a 
two-dimensional image region into a plurality of sub -regions each 
having A pixels (A is an integer equal to or greater than 2) and 
sets each of all the projecting directions that can be set for 

20 one pixel in each of the sub-regions, to project the two- 
dimensional image information with the low resolution, the low 
resolution being 1/A of the resolution of the projecting means, 
thereby displaying a three-dimensional image with a low 
resolution, and repeatedly performs a process of projecting the 

25 two-dimensional image information with the low resolution A times 
while changing pixels to which a specific projecting direction 
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is assigned in the sub-regions, to display a three-dimensional 
image willi scjt.c resolution ?_« resolution of the projecting 
means. In this case, for example, the display control means 
divides all of the projecting directions that can be set into 
groups each consisting of A projecting directions, and repeatedly 
performs a process of projecting the two-dimensional image 
information with the low resolution in the A photographing 
directions, thereby projecting the two-dimensional image 
information with the low resolution in all of the photographing 
directions that can be set. 

In the three-dimensional image display apparatus of the 
invention, for example, the projecting direction setting means 
may have defecting means for deflecting light by selecting a 
direction for exiting light. 

A method for displaying a three-dimensional image 
according to the invention is a method for displaying a 
three-dimensional image of an object in a space by projecting a 
plurality of pieces of two-dimensional image information of the 
object obtained by viewing the object in different viewing 
directions, in projecting directions associated with the 
respective viewing directions, using projecting means for 
projecting the two-dimensional image information of the object 
and projecting direction setting means for setting a projecting 
direction for the projecting means , capable of setting a different 
photographing direction for each pixel of the two-dimensional 
image information. The method includes: a first step for 
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controlling the projecting direction setting means, so as to 
acquire, in every projecting direction that can be set, two- 
dimensional image information with a low resolution that is lower 
than the resolution of the projecting means, to thereby display 
5 a three-dimensional image with a low resolution; and a second step 
for repeatedly performing the first step while changing pixels 
to which a specific projecting direction is assigned, to thereby 
display a three-dimensional image with a resolution that is the 

r"* s 

i[| same as the resolution of the projecting means. 

U\ 10 In the method for displaying a three-dimensional image. 

Hi 

If! at the first step, the projecting direction setting means is 

RJ controlled so that the two-dimensional image information with a 

5 

W low resolution that is lower than the resolution of the projecting 

Sj 

^ means is projected in every projecting direction that can be set, 

it\ 

^ 15 and a three-dimensional image with a low resolution is displayed. 

At the second step, the first step is repeatedly performed while 
changing pixels to which a specific projecting direction is 
assigned, and a three-dimensional image with a resolution that 
is the same as the resolution of the projecting means is thereby 

20 displayed. 

In the method for displaying a three-dimensional image of 
the invention, for example, the first step divides a two- 
dimensional image region into a plurality of sub-regions each 
having A pixels (A is an integer equal to or greater than 2) and 

25 sets each of all the projecting directions that can be set for 
one pixel in each of the sub-regions, to project the two- 
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dimensional image information with the low resolution, the low 
resuiuLivii being 1/A cf the r^^lntion of the projecting means, 
thereby displaying a three-dimensional image with the low 
resolution, and the second step repeatedly performs the first step 
5 A times while changing pixels to which a specific projecting 
direction is assigned in the sub-regions, to display a three- 
dimensional image with the same resolution as the resolution of 
the projecting means. In this case, for example, the first step 

O divides all of the projecting directions that can be set into 

«. ?* 

£0 10 groups each consisting of A photographing directions, and 

Cm 

repeatedly performs a process of projecting two-dimensional image 
™ information with the low resolution in the A projecting directions , 

to project two-dimensional image information with the low 
resolution in all of the projecting directions that can be set. 
15 A three-dimensional image display position converting 

apparatus of the present invention is used in a system for 
displaying a three-dimensional image of an object in a space by 
projecting a plurality of pieces of two-dimensional image 
information of the object obtained by viewing the object in 
20 different viewing directions, in projecting directions 
associated with the respective viewing directions . The apparatus 
converts the position of the three-dimensional image of the object 
displayed in the space, and the apparatus has: quantity-of- 
movement calculating means for identifying a quantity of a 
25 movement of a position of the two-dimensional image information 
in a direction in the plane thereof that is required for moving 
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a position of the three-dimensional image by a specific quantity 
of movement , based on information on t]?e quantity of movement of 
the position of the three-dimensional image and the viewing 
directions or projecting directions; and position changing means 
for changing the position of the two-dimensional information by 
the quantity of movement identified by the quantity- of -movement 
calculating means. 

According to the three-dimensional image display position 
converting apparatus of the invention, the quantity- of -movement 
calculating means identifies a quantity of movement of the 
two-dimensional image information in a direction in the plane 
thereof that is required for moving a position of the three- 
dimensional image by a specific quantity of movement, based on 
information on the quantity of movement of the position of the 
three-dimensional image and the viewing directions or projecting 
directions , and the position changing means changes the position 
of the two-dimensional image information by the quantity of 
movement identified by the quantity- of -movement calculating 
means . 

In the three-dimensional image display position converting 
apparatus of the invention, for example, the quantity-of -movement 
calculating means identifies the quantity of movement of the 
position of the two-dimensional image information as a value 
proportionate to "b" which is expressed by b = a x tan0i where 
"a" represents the quantity of movement of the three-dimensional 
image and 8i represents the viewing directions or projecting 
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directions . 

in the Lhj.cc-cliirier.3icn^l ±™?<2* rH splay position converting 
apparatus of the invention, for example, the position changing 
means has: storage means for storing the two-dimensional image 
5 information; and address control means for changing the position 
of the two-dimensional image information by controlling write 
addresses for writing the information in the storage means and 
read addresses for reading the information from the storage means . 

Q 

*0 The three-dimensional image display position converting 

CO 

y * 10 apparatus of the invention may be provided in a three-dimensional 

HJ 

*il image photographing apparatus for photographing an object in a 

plurality of viewing directions to generate a plurality of pieces 
of two-dimensional image information of the object in different 
viewing directions. Alternatively, the three-dimensional image 
15 display position converting apparatus may be provided in a 
three-dimensional image display apparatus for displaying a 
three-dimensional image of an object in a space by projecting a 
plurality of pieces of two-dimensional image information of the 
object obtained by viewing the object in different viewing 
20 directions, in projecting directions associated with the 
respective viewing directions. 

A method for converting a display position of a three- 
dimensional image of the present invention is a method for 
converting a position of a three-dimensional image of an object 
25 in a space, and is used in a system for displaying a three- 
dimensional image of an object in a space by projecting a plurality 
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of pieces of two-dimensional image information of the object by 
viewing the uujcO'c in different vie^«« directions , in projecting 
directions associated with the respective viewing directions. 
The method includes: a quantity- of -movement calculating step for 
5 identifying a quantity of a movement of a position of the 
two-dimensional image information in a direction in the plane 
thereof that is required for moving a position of the three- 
dimensional image by a specific quantity of movement, based on 
Q information on the quantity of movement of the position of the 

10 three-dimensional image and the viewing directions or projecting 
J-; directions ; and a position changing step for changing the position 

JJ* of the two-dimensional information by the quantity of movement 



identified by the quantity- of -movement calculating step. 

According to the method for converting the display position 

15 of a three-dimensional image of the invention, the quantity - 
of -movement calculating step identifies the quantity of movement 
of the position of the two-dimensional image information in a 
direction in the plane thereof that is required for moving the 
position of the three-dimensional image by a specific quantity 

20 of movement, based on information on the quantity of movement of 
the position of the three-dimensional image and the viewing 
directions or projecting directions, and the position changing 
step changes the position of the two-dimensional image 
information by the quantity of movement identified by the 

25 quantity- of -movement calculating step. 

In the method for converting the display position of a 
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three-dimensional image of the invention, for example, the 
quantity-of -moveiiicii'c calculating step ■» notifies the quantity of 
movement of the position of the two-dimensional image information 
as a value proportionate to "b" which is expressed by b = a x tan8i 
where "a" represents the quantity of movement of the three- 
dimensional image and 0i represents the viewing directions or 
projecting directions. 

In the method for converting the display position of a 
three-dimensional image of the invention, for example, the 
position changing step changes the position of the two- 
dimensional image information by controlling write address for 
storing information in storage means for storing the two- 
dimensional image information and read address for reading the 
information from the storage means. 

The above and other objects, features and advantages of 
the invention will become sufficiently apparent from the 
following description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is an illustration showing a schematic configuration 
of a three-dimensional image photographing apparatus of a first 
embodiment of the invention. 

Fig. 2 is an illustration showing a schematic configuration 
of a three-dimensional image display apparatus of the first 
embodiment of the invention. 

Fig. 3 is an illustration for explaining a positional 
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relationship between the three-dimensional image photographing 
apparatus and Liu.ce-clin;cn3icr^l irr.acje display apparatus of the 
first embodiment of the invention. 

Fig. 4 is an illustration for explaining another positional 
relationship between the three-dimensional image photographing 
apparatus and three-dimensional image display apparatus of the 
first embodiment of the invention. 

Fig. 5 is a block diagram of the three-dimensional image 
photographing apparatus of the first embodiment of the invention 
showing a configuration thereof. 

Fig. 6 is an illustration showing association and 
relationship between angles of incident light selected by the 
deflecting plate in Fig. 5 and images acquired by the CCD. 

Fig. 7 is an illustration showing a configuration of a 
liquid crystal device used in the deflecting plate in Fig. 5. 

Fig. 8 is an illustration showing a configuration of the 
deflecting plate in Fig. 5. 

Fig. 9 is an illustration for explaining an operation of 
the deflecting plate shown in Fig. 8. 

Fig. 10 is an illustration for explaining an operation of 
the deflecting plate shown in Fig. 8. 

Fig. 11 is a block diagram of a three-dimensional image 
display apparatus of the first embodiment of the invention showing 
a configuration thereof. 

Fig. 12 is an illustration showing association and 
relationship between two-dimensional images formed by the LCD in 
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Fig- 11 and angles of light exiting the deflecting plate. 

Jtig. 13 is a perspective vie™ shoeing the converging lens, 
deflecting plate, and diffusing plate in Fig. 12. 

Fig. 14 is an illustration for explaining an operation of 
the deflecting plate in Fig. 11 

Fig. 15 is an illustration for explaining an operation of 
the deflecting plate in Fig. 11. 

Fig. 16 is an illustration for explaining a principle behind 
a display position converting process in the first embodiment of 
the invention. 

Fig. 17 is a block diagram of ah example of a configuration 
of the display position converting circuits in Figs. 5 and 11. 

Fig. 18 is an illustration of an example of a method for 
photographing a three-dimensional image in the first embodiment 
of the invention. 

Fig. 19 is an illustration of an example of a method for 
displaying a three-dimensional image in the first embodiment of 
the invention. 

Fig. 20 is an illustration showing a schematic 
configuration of a three-dimensional image photographing 
apparatus of a second embodiment of the invention. 

Fig. 21 is an illustration showing a schematic 
configuration of a three-dimensional image display apparatus of 
the second embodiment of the invention. 

Fig. 22 is a block diagram of the three-dimensional image 
photographing apparatus of the second embodiment of the invention 
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showing a configuration thereof. 

Fig. 23 is a biuuk Jiagran; cf the i-H-r^- dimensional image 
display apparatus of the second embodiment of the invention 
showing a configuration thereof. 
5 Fig. 24 is an illustration showing a schematic 

configuration of a three-dimensional image photographing 
apparatus of a third embodiment of the invention. 

Fig. 25 is an illustration showing a schematic 
configuration of a three-dimensional image display apparatus of 
10 the third embodiment of the invention. 

Fig. 26 is a block diagram of the three-dimensional image 
photographing apparatus of the third embodiment of the invention 
showing a configuration thereof. 

Fig. 27 is a block diagram of the three-dimensional image 
15 display apparatus of the third embodiment of the invention showing 
a configuration thereof. 

Fig. 28 is an illustration of an example of an optical member 
for changing a photographing direction and a projecting direction 
of a two-dimensional image in a modification of the third 
20 embodiment of the invention. 

Fig. 29 is an illustration of another example of the optical 
member for changing a photographing direction and a projecting 
direction of a two-dimensional image in a modification of the third 
embodiment of the invention. 
25 Fig. 30 is an illustration showing a format representing 

a photographing direction and a projecting direction for each 
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pixel in a fourth embodiment of the invention. 

Fig. 31 is an illustration shoving the format representing 
a photographing direction and a projecting direction for each 
pixel in the fourth embodiment of the invention. 

Fig. 32 is an illustration showing the format representing 
a photographing direction and a projecting direction for each 
pixel in the fourth embodiment of the invention. 

Fig. 33 is an illustration showing the format representing 
a photographing direction and a projecting direction for each 
pixel in the fourth embodiment of the invention. 

Fig. 34 is an illustration showing the format representing 
a photographing direction and a projecting direction for each 
pixel in the fourth embodiment of the invention. 

Fig. 35 is an illustration showing the format representing 
a photographing direction and a projecting direction for each 
pixel in the fourth embodiment of the invention. 

Fig. 36 is an illustration of a configuration of a 
television conference system in a fifth embodiment of the 
invention. 

BEST MODES FOR CARRYING OUT THE INVENTION 

A detailed description will now be made with reference to 
the drawings on apparatuses and methods for photographing a 
three-dimensional image, apparatuses and methods for displaying 
a three-dimensional image, and apparatuses and methods for 
converting the display position of a three-dimensional image 
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according to embodiments of the invention. 
[First Embodiment j 

First, a description will be made with reference to Figs. 
1 and 2 on principles behind photographing and display of a 
three-dimensional image in a first embodiment of the invention. 

Fig. 1 is an illustration showing a schematic configuration 
of a three-dimensional image photographing apparatus of the 
present embodiment. The three-dimensional image photographing 



J} apparatus of the present embodiment has: a deflecting plate 11 

CO 

91 10 capable of selecting a direction for incident light and a direction 

ra 

lH for exiting light in a predetermined range of angles; a converging 

Hi lens 12 provided in a face-to-face relationship with one surface 

%J of the deflecting plate 11; and a pinhole member 13, a converging 

SI 

lens 14 and a CCD (charge coupled device) 15 provided in that order 
15 on the side of the converging lens 12 opposite to the deflecting 
plate 11. The pinhole member 13 has a pinhole that allows light 
to pass through. 

In the three-dimensional image photographing apparatus, 
the surface of the deflecting plate 11 opposite to the converging 
20 lens 12 is directed at an object 10 to be photographed. The 
deflecting plate 11 corresponds to the photographing direction 
control means of the invention. When parallel beams of light 
perpendicularly enter the converging lens 12 from the deflecting 
plate 11, it converges the light such that the exiting light will 
25 have a smallest diameter in the position of the pinhole of the 
pinhole member 13. For example, a Fresnel lens is used as the 
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converging lens 12. The converging lens 14 forms an image of the 
m ~_ = n », n fAnr a nhir. snrfar.e of the CCD 15 by converging 

Ui/jcvc J- ^ v*. «— jc - 

light that has diffused after passing through the pinhole. The 
converging lens 12, pinhole member 13, converging lens 14. and 
5 CCD 15 correspond to the photographing means of the invention. 

An operation of the three-dimensional image photographing 
apparatus shown in Fig. 1 will now be described. Light from the 
object 10 enters the deflecting plate 11. The deflecting plate 
11 selectively allows only beams of light at a predetermined angle 
10 to the plane of the deflecting plate 11 to pass through among the 
incident beams of light to cause them to exit as parallel beams 
of light perpendicular to the plane of the deflecting plate 11. 
The converging lens 12 converges the parallel beams of light from 
the deflecting plate 11. The beams of light pass through the 
15 pinhole of the pinhole member 13 and are converged by the 
converging lens 14 to enter the CCD 15. A two-dimensional image 
of the object 10 in a predetermined viewing direction is formed 
on the photographic surface of the CCD 15. In the three- 
dimensional image photographing apparatus, a photographic 
20 operation is performed based on an assumption that a view point 
16 is in a position that is opposite to the object 10 with respect 
to the deflecting plate 11 and converging lens 12 located between 
them. The angle of incident beams of light selected at the 
deflecting plate 11 is changed sequentially as time passes. 
25 Thus, in the three-dimensional image photographing 

apparatus shown in Fig. 1. the object 10 is photographed with the 
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single photographing means (CCD 15 or the like) to generate 
two-uiiucrisional iir.agc inf orm?. ,M nr » of the object 10 , and the 
photographing direction is sequentially changed. Therefore, 
image information output by the CCD 15 is a plurality of pieces 
of two-dimensional image information for which the photographing 
direction changes as time passes and which serve as image 
information required for displaying a three-dimensional image of 
the object in a space. 

Fig. 2 is an illustration showing a schematic configuration 
of a three-dimensional image display apparatus of the present 
embodiment . The three-dimensional image display apparatus of the 
present embodiment has a transmission type liquid crystal display 
(hereinafter referred to as "LCD" ) 21 as a spatial light modulator 
that spatially modulates light passing therethrough based on 
two-dimensional image information, and a converging lens 22, a 
pinhole member 23, a converging lens 24 and a deflecting plate 
25 provided in that order on the light exit side of the LCD 21. 
The pinhole member 23 has a pinhole that allows light to pass. 
The converging lens 22 converges light exiting the LCD 21 to a 
minimum diameter in the position of the pinhole of the pinhole 
member 23. The converging lens 24 collimates light that has 
passed through the pinhole. For example, a Fresnel lens is used 
as the converging lens 24. The deflecting plate 25 causes light 
from the converging lens 24 to exit as parallel beams of light 
at a predetermined angle to the plane of the deflecting plate 25. 
The LCD 21, converging lens 22, pinhole member 23, converging lens 
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24, and deflecting plate 25 correspond to the projecting means 
of twC invention. The ^lArting plate 25 corresponds to the 
projecting direction setting means of the invention. 

An operation of the three-dimensional image display 
apparatus shown in Fig. 2 will now be described. The LCD 21 
spatially modulates light based on two-dimensional image 
information acquired by the three-dimensional image 
photographing apparatus shown in Fig . 1 . The light modulated by 
the LCD 21 is converged by the converging lens 22, passes through 
the pinhole of the pinhole member 23, and is collimated by the 
converging lens 24 to enter the deflecting plate 25. The 
deflecting plate 25 causes the light from the converging lens 24 
to exit as parallel beams of light at a predetermined angle to 
the plane of the deflecting plate 25. The angle of the beams of 
light exiting the deflecting plate 25 sequentially changes as time 
passes such that they coincide with the angle of the beams of light 
incident upon the deflecting plate 11 at the time of photographing. 

Thus, according to the three-dimensional image display 
apparatus shown in Fig. 2, light is modulated by the LCD 21 to 
reproduce two-dimensional images based on the two-dimensional 
image information acquired by the three-dimensional image 
photographing apparatus shown in Fig. 1 for which the 
photographing direction changes. The two-dimensional images 
exit the deflecting plate 25 at an angle that coincides with the 
angle of the beams of light incident upon the deflecting plate 
11 at the time of photographing . As a result , a three-dimensional 
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image ( stereoscopic image) 20 of the object 10 is formed in a space . 
A vicwci 2C located cn the ll^t t side of the deflecting plate 
25 can view the three-dimensional image 20. 

The two-dimensional image information supplied to the LCD 
21 is two-dimensional image information that is a result of 
inversion of the two-dimensional image information acquired by 
the three-dimensional image photographing apparatus shown in Fig. 
1 in the vertical and horizontal directions. To display a 
stereoscopic three-dimensional image only in the horizontal 
direction, it is only required to supply two-dimensional image 
information that is an inversion of the two-dimensional image 
information acquired by the three-dimensional image 
photographing apparatus shown in Fig. 1 in the horizontal 
direction. In this case, it is required to provide a diffusing 
plate for diffusing light in the vertical direction on the light 
exit side of the deflecting plate 25. For example, the diffusing 
plate is constituted by a vertical array of a multiplicity of very 
small semicylindrical lenses extending in the horizontal 
direction . 

A conceptual description will be made with reference to 
Figs. 3 and 4 on the positional relationship between the 
three-dimensional image photographing apparatus and three- 
dimensional image display apparatus of the present embodiment by 
presenting an example in which a stereoscopic three-dimensional 
image is displayed only in the horizontal direction. Fig. 3 is 
an illustration showing an optical system in which the optical 
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system of the three-dimensional image display apparatus shown in 
Fig. z overlaps LI 16 optical eye tern of three-dimensional image 
photographing apparatus shown in Fig. 1. Fig. 4 is an 
illustration showing an optical system in which the optical system 
5 of the three-dimensional image photographing apparatus shown in 
Fig. 1 overlaps the optical system of the three-dimensional image 
display apparatus shown in Fig. 2. In the optical system shown 
in those figures, an imaginary half mirror 27 is provided between 



ui the converging lens 12 and the pinhole member 13 . The half mirror 



10 27 is provided such that the normal of a reflecting surface thereof 
is at 45 degrees to the optical axis of the optical system of the 
three-dimensional image photographing apparatus. The pinhole 
member 23, converging lens 22 and LCD 21 of the three-dimensional 
image display apparatus are located in a direction in which light 

15 from the converging lens 12 travels after being reflected by the 
half mirror 27. 

At the time of photographing, an image of the object 10 
is formed on the CCD 15. At this time, if the light from the 
converging lens 12 is reflected by the half mirror 27 to form an 

20 image on the LCD 21, the image formed on the LCD 21 is an image 
that is an inversion of the image formed on the CCD 15 in the 
horizontal direction. For display, the LCD 21 is driven to form 
the inverted image. 

The configuration of the three-dimensional image 

25 photographing apparatus of the present embodiment will now be 
described in detail with reference to Fig. 5. Fig. 5 is a block 
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diagram of the three-dimensional image photographing apparatus 
or the p-LtsseuL em^odir.crit chcv. 7 ir_cj + ' h ^ nonf iauration thereof. In 
addition to the configuration shown in Fig. 1, the three- 
dimensional image photographing apparatus has: a CCD driving 
5 circuit 31 for driving the CCD 15; a signal processing circuit 
32 for processing signals output by the CCD 15 to output image 
signals; a display position converting circuit 33 to which the 
signals output by the signal processing circuit 32 are input and 
O which performs a display position converting process to be 

10 described later as needed; an operating portion 34 for supplying 
information on the quantity of a movement of a display position 
to the display position converting circuit 33; and an output 
circuit 35 for superimposing synchronization signals to the 
output of the display position converting circuit 33 to output 
15 video signals. Further, the three-dimensional image 
photographing apparatus has: a deflecting plate driving circuit 
36 for driving the deflecting plate 11 ; an angle pattern generating 
circuit 37 for supplying the deflecting plate driving circuit 36 
with information on spatial and temporal patterns of selected 
20 angles for incident light; and a timing control circuit 38 for 
controlling the timing of the operation of each of the above- 
described circuits. 

The CCD 15 may be intended for either of monochrome and 
color images . For example, when a CCD 15 for color images is used, 
25 it may be a single plate/color filter type having filters in colors 
R, G, and B and, alternatively, it may be a three plate type 
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including color separating means for separating incident light 
into the colors k, G, cmJ D and three ^cr.^^^ome CCDs for receiving 
the separated light. 

An operation of the three-dimensional image photographing 
5 apparatus shown in Fig. 5 will now be described. The deflecting 
plate driving circuit 36 drives the deflecting plate 11 such that 
the angle of incident light selected by the deflecting plate 11 
sequentially changes in a predetermined period. The following 
description is based on an assumption that the angle of incident 
10 light selected by the deflecting plate 11 changes from 81 to 060 



01 

m 

III with increments of A9. For example, A6 is one degree. 



The CCD driving circuit 31 drives the CCD 15 in synchronism 
q with the driving of the deflecting plate 11 by the deflecting plate 

p driving circuit 36 such that information on one two-dimensional 

q 15 image can be acquired for each angle of incident light selected 
by the deflecting plate 11. Signals output by the CCD 15 are 
processed by the signal processing circuit 32 into image signals. 
The image signals are subjected to the display position converting 
process at the display position converting circuit 33 as necessary, 
20 and transmitted to the output circuit 35. Then, the output 
circuit 35 outputs video signals. The operation and 
configuration of the display position converting circuit 33 will 
be described in detail later. 

Fig. 6 is an illustration showing association and 
25 relationship between angles of incident light selected by the 
deflecting plate 11 and images acquired by the CCD 15. As shown 



33 



in the figure, the angle of incident light selected by the 

_ . * qi 4-^ A*n ui tb anaular increments 

deflecting piare xj. uiany^ — — - 

of A6 (= 1 degree) . The CCD 15 acquires a two-dimensional image 
of an object to be photographed at each of angles 6i (i - 1. 2. 
5 60). in the present embodiment, one two-dimensional image 
acquired at each of the angles 9i is referred to as "an image for 
one field". Therefore, scan at the angles of incident light 61 
through 860 provides two-dimensional images for 60 fields. In 
the following description, a set of two-dimensional images 
10 obtained by the scan at the angles 61 through 660 is referred to 
as "images for 60 space fields". One three-dimensional still 
i.nage is formed by images for 60 space fields. Therefore, the 
60 space fields at the angles 61 through 660 are referred to as 
■one space frame" . The image acquisition at the angles 61 through 
15 660 is controlled such that it is performed at respective points 
in time tl through t60. 

When the acquisition of the images for the 60 space fields 
at the angles 61 through 860 is completed, further images for the 
60 space fields at the angles 81 through 860 are acquired at 
20 subsequent points in time t61 through t!20. Thereafter, the 
acquisition of images for 60 space fields each is similarly 
repeated. When this is repeated 60 times, images for 3600 fields 
are acquired in total. For a certain angle 8i of interest, images 
for 60 fields are acquired at points in time ti through t(i ♦ 60 
25 x 59). in the following description, two-dimensional images 
acquired at points in time ti through t(i ♦ 60 x 59) at each angle 



34 



8i is referred to as "images for 60 time fields". 

Let uc aesu^.e he 7 *** that it takes 1/60 sec. to change the 
angle of incident light from the angle 81 to 660 and to acquire 
images for the 60 space fields. Then, a period At for a change 
of the angle of incident light and image acquisition is 1/3600 
sec, and images for 3600 fields are acquired in one sec. 

An example of a configuration of the deflecting plate 11 
of the three-dimensional image photographing apparatus will now 
be described. Fig. 7 shows a configuration of a liquid crystal 
device used for the reflecting plate 11 . A liquid crystal device 
40 is formed using an element referred to as "polymer dispersed 
liquid crystal (PDLC)" or "liquid crystal polymer composite". 
This polymer dispersed liquid crystal element has a function of 
allowing an opaque state and a transparent state to be switched 
depending on the viewing angle utilizing an effect of a match 
between the refractive indices of the polymer and liquid crystal 
which is achieved by applying a voltage to the composite of the 
polymer and liquid crystal to align the orientation of the liquid 
crystal molecules with the direction of the electric field. 

The liquid crystal device 40 has: a polymer/ liquid crystal 
composite layer 43 formed by dispersing needle-shaped liquid 
crystal molecules 42 of a few microns or less in a polymeric 
material 41; and stripe electrodes 44 and 45 with a microscopic 
width which are formed on an entrance surface and an exit surface 
of the polymer/liquid crystal composite layer 43 such that they 
face each other with the polymer/ liquid crystal composite layer 
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43 interposed therebetween and such that they extend in the 
direction orthogonal tu Liie plane cf the f* gnre. While the stripe 
electrodes 44 and 45 may be provided such that the directions of 
the stripes (the longitudinal directions of the electrodes) are 
5 in parallel with each other as described above, for example, the 
so-called simple matrix arrangement in which the directions of 
the stripes are orthogonal to each other may be employed. 
Alternatively, an active matrix arrangement configured using TFTs 
(thin film transistors) or the like may be employed. In those 
10 cases, the deflecting direction control can be performed in two 
directions . 

The stripe electrodes 44 and 45 are formed of transparent 
conductive films such as ITOs (indium tin oxides) and extend in 



Q the direction orthogonal to the plane of the figure (longitudinal 

£11 

-Q 15 direction). A predetermined voltage is selectively applied 



between the stripe electrodes 44 and 45. lPx in the figure 
represents a region corresponding to one pixel. The stripe 
electrodes 44 and 45 are arranged at a pitch which is kept as small 
as possible provided that the 60 angles 61 through 060 can be 

20 accommodated. 

Liquid crystal optical axes (longitudinal axes) of the 
liquid crystal molecules 42 are oriented in random directions in 
the polymeric material 41 when no voltage is applied thereto. In 
this state, the effective refractive index of the liquid crystal 

25 molecules 42 and the refractive index of the polymeric material 
41 do not match, and the polymer/ liquid crystal composite layer 
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43 as a whole is in an opaque and white state as a result of a 

between the liquid crystal 

light scattering erxeuu — 

m0 lecules 42 and polymeric Serial 41. On the contrary, when 
a voltage is selectively applied between the stripe electrodes 
5 44 and 45. the directions of the optical axes of the liquid crystal 
molecules 42 are aligned in coincidence with the direction of the 
electric field within a small range of expansion of the resultant 
electric field. Xs a result, the apparent refractive index of 
the liquid crystal molecules 42 will have a value no which is a 
10 value of the liquid crystal molecules 42 associated with normal 
beams of light. Therefore, use of a polymeric material 41 having 
a refractive Index substantially equal to nO eliminates the 
difference between the refractive indices of the liquid crystal 
molecules 42 andpolymerlc material 41 at interfaces between them. 
U which reduces the light scattering effect in the direction of the 
electric field to maXe the polymer/liquid crystal composite layer 
43 transparent. Specifically, light passes only in the direction 

of the electric field. 

F or example, let us assume here that L represents the 
20 thlcxness of the polymer/liquid crystal composite layer 43, and 
p represents the pitch at which the stripe electrodes 44 and 45 
are arranged. In this case: 

tan6i = di/L = p x ni/L 
where H represents the angle of the direction of light passing 
25 through the polymer/liquid crystal composite layer 43 to the 
normal of the surface of the polymer/liquid crystal layer 43; m 
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represents the quantity of an offset between the stripe electrodes 
44 ana 45 <il LliaL ti*T»c in the horizontal direction represented 
in terms of the number of pitches; and di represents the quantity 
of the offset between the stripe electrodes 44 and 45 represented 
5 in terms of distance. Then, the number ni of horizontal offset 
pitches between the stripe electrodes 44 and 45 required for 
achieving a predetermined angle 5i is expressed by the following 
Equation (1) where i = 1, 2, . .., 60. 
ni = L x tan8i/p ... ( 1 ) 
10 Fig. 8 shows a configuration of the deflecting plate 11 

utilizing the above-described liquid crystal device 40. As shown 



fjjj in the figure, the deflecting plate 11 used in the three- 

3 

□ dimensional image photographing apparatus has a structure in 

which two liquid crystal devices 40 are overlapped with each other . 
15 Hereinafter, the liquid crystal device 40 on the entrance side 
of the deflecting plate 11 is represented by reference number 4 OA, 
and the liquid crystal device 40 on the exit side is represented 
by reference number 40B. The stripe electrodes 44 and 45 are 
omitted in the illustration of Fig. 8. The interface between the 
20 liquid crystal devices 40A and 40B is a light scattering surface. 

The deflecting plate 11 is driven as follows . In the liquid 
crystal device 4 OA, the application of a voltage to the stripe 
electrodes 44 and 45 is controlled such that the angle 5i of light 
passing through the device becomes selected angles 81 through 960 
25 of incident light. Light that has passed through the liquid 
crystal device 40A is scattered at the light scattering surface 
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between the liquid crystal devices 40A and 40B. In the liquid 
crystal device 405, Llie application ^ a voltage to the stripe 
electrodes 44 and 45 is controlled such that only beams of light 
perpendicular to the plane of the liquid crystal device 40B pass 
through the liquid crystal device 40B among the beams of light 
that have passed through the liquid crystal device 40A and 
scattered at the light scattering surface- As a result, only 
beams of light that have entered at an angle 8i pass through the 
deflecting plate 11 and exit the deflecting plate 11 
perpendicularly to the plane thereof. 

Fig. 9 shows an operation of the deflecting plate 11 when 
incident light is at the angle 81, and Fig. 10 shows an operation 
of the deflecting plate 11 when incident light is at the angle 
860. As shown in those figures, the application of a voltage to 
the stripe electrodes 44 and 45 of the liquid crystal devices 40A 
and 4 OB is controlled such that the pair of electrodes to which 
the voltage is applied are sequentially shifted, for example, from 
the left side to the right side as indicated by the arrow in the 
figure while keeping the angle 6i between a straight line 
connecting each pair of electrodes to which the voltage is applied 
and the plane of the deflecting plate 11. More specifically, scan 
for applying a pulse voltage to the stripe electrodes 44 arranged 
on the side of the exit surface sequentially (hereinafter referred 
to as "voltage application scan" ) is performed in synchronism with 
voltage application scan for applying a pulse voltage to the stripe 
electrodes 45 arranged on the side of the entrance surface 
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sequentially at predetermined time intervals. At this time, 
control is jerfnn«fl to maintain a horizontal offset distance 
associated with the angle 6i between a stripe electrode 45 on the 
side of the entrance surface to which the voltage is applied and 
a stripe electrode 44 on the side of the exit surface to which 
the voltage is applied. Such an operation is simultaneously 
performed in each region associated with each pixel. 

Voltage application scan for one angle 9i is performed in 
a time period of 1/3600 sec. Therefore, the time required for 
voltage application scan for all of the angles 91 through 960 is 
1/60 sec. 

For example, the polymer/ liquid crystal composite layer 
43 is formed using a method wherein a solution of a polymer and 
a liquid crystal is applied to a substrate and the solvent is 
evaporated thereafter, or a method utilizing an effect of 
formation of small liquid crystal droplets as a result of 
deposition of the liquid crystal that occurs when monomers of a 
polymeric material is polymerized and hardened . However , it may 
be formed using other methods. For example, it may have a 
structure in which a nematic liquid crystal is dispersed in an 
aqueous solution of polyvinyl alcohol (PVA) or the like to form 
microcapsules of liquid crystal droplets or a structure in which 
a small amount of a gelatine polymeric material is dispersed in 
a liquid crystal. While spherical liquid crystal molecules are 
used in a conventional polymer dispersed liquid crystal, it is 
desirable that liquid crystal molecules have a needle-like shape 
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for applications like the present embodiment in which they must 
have direo^vi ty. For example, methods for forming such a 
needle-shaped liquid crystal includes a method in which a liquid 
crystal is deposited in a uniform magnetic field to form 
5 microcapsules. According to this method, needle-shaped liquid 
crystal molecules 42 are formed as a result of a tidal effect in 
the direction of a magnetic field. 

A configuration of the three-dimensional image display 
apparatus in the present embodiment will now be described in detail 

10 with reference to Fig. 11. Fig. 11 is a block diagram of the 
three-dimensional image display apparatus in the present 
embodiment showing the configuration thereof. In addition to the 
configuration shown in Fig. 2, the three-dimensional image 
display apparatus has: a light source portion 50 for supplying 

15 parallel beams of illuminating light to the LCD 21; a 
synchronization separation circuit 51 to which video signals are 
input and which separates synchronization signals from the video 
signals and outputs the video signals and synchronization 
signals; a signal processing circuit 52 for performing signal 

20 processing on the video signals output by the synchronization 
separation circuit 51 to output image signals; a display position 
converting circuit 53 to which signals output by the signal 
processing circuit 52 are input and which performs a display 
position converting process to be described later as needed; an 

25 operating portion 54 for supplying information on the quantity 
of a movement of a display position to the display position 
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converting circuit 53; and an LCD driving circuit 55 for driving 
tne LCD 21 based en si™* 1 * output by the display position 
converting circuit 53. Further, the three-dimensional image 
display apparatus has : a deflecting plate driving circuit 56 for 
5 driving the deflecting plate 25; an angle pattern generating 
circuit 57 for supplying the deflecting plate driving circuit 56 
with information on spatial and temporal patterns of selected 
angles of incident light; and a timing control circuit 58 to which 
the synchronization signals output by the synchronization 

10 separation circuit 51 are input and which controls the timing of 
the operation of each of the above -described circuits in 
synchronism with the synchronization signals. 

The LCD 21 may form either of monochrome and color images. 
For example, when color images are to be formed, a single 

15 plate/color filter type LCD having filters in the colors R, G, 
and B is used as the LCD 21. For example, a ferroelectric liquid 
crystal (FLC) capable of operating at a high speed is used in the 
liquid crystal portion of the LCD 21. Instead of the light source 
portion 50 and LCD 21 , there may be provided a white light source, 

20 color separating means such as a dichroic mirror or dichroic prism 
for separating light emitted by the white light source into the 
colors R, G, and B, three monochrome LCDs for spatially modulating 
beams of light separated by the color separating means according 
to respective R, G, and B image signals, and synthesizing means 

25 for synthesizing and outputting the beams of light in R, G, and 
B modulated by the monochrome LCDs. 
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An operation of the three-dimensional image display 
appcu.aLuS shovrr* in Fig. I 1 win now be described. For example, 
video signals acquired by the three-dimensional image 
photographing apparatus shown in Fig. 5 are input to the 
three-dimensional image display apparatus. The synchronization 
separation circuit 51 separates synchronization signals from the 
input video signals and outputs the video signals and 
synchronization signals. The video signals are processed by the 
signal processing circuit 52 into image signals. The image 



\0 

W 10 signals are subjected to a display position converting process 



at the display position converting circuit 53 as needed and 
transmitted to the LCD driving circuit 55. The LCD 21 is driven 
by the LCD driving circuit 55 based on the image signals. 

Parallel beams of illuminating light emitted by the light 

15 source portion 50 are spatially modulated by the LCD 21. A 
two-dimensional image is thus formed. Light which has exited the 
LCD 21 impinges upon the deflecting plate 25 as parallel beams 
of light through the converging lens 22 , the pinhole of the pinhole 
member 23, and the converging lens 24. 

20 The deflecting plate driving circuit 56 drives the 

deflecting plate 25 such that the angle of light exiting the 
deflecting plate 25 sequentially changes in a predetermined 
period. The angle of light exiting the deflecting plate 25 is 
controlled such that it coincides with the angle of incident light 

25 when each two-dimensional image formed by the LCD 21 is 
photographed by the three-dimensional image photographing 
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apparatus . Such angle control is performed by the timing control 
circuit 53 based en the synchronization signals separated by the 
synchronization separation circuit 51. 

Fig. 12 is an illustration showing association and 
5 relationship between two-dimensional images formed by the LCD 21 
and angles of light exiting the deflecting plate 25 . It is assumed 
here that a stereoscopic three-dimensional image is displayed 
only in the horizontal direction. For this purpose, as shown in 
Fig. 12, a diffusing plate 29 for diffusing light in the vertical 
gi 10 direction is provided on the light exit side of the deflecting 

?ii 

!J1 plate 25. Fig. 13 is a perspective view of the converging lens 

if* 

CO 24, deflecting plate 25, and diffusing plate 29. As shown in the 

figure, the diffusing plate 29 diffuses light exiting the 
deflecting plate 25 at a predetermined angle a in the vertical 
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2 

□ 15 direction. 

As shown in Fig. 12, the angle of light exiting the 
deflecting plate 25 changes from 01 to 860 with angular increments 
of A6 (= 1 degree). The LCD 21 forms a two-dimensional image in 
association with each of angles 6i (i = 1, 2, 60) . Therefore, 

20 scan at the angles of the exiting light 01 through 060 results 
in projection of two-dimensional images for 60 fields in 
respective different directions. The formation of the two- 
dimensional images at the angles 01 through 060 is performed at 
respective points in time tl through t60. 

25 When the formation of the images for the 60 space fields 

at the angles 01 through 060 is completed, further images for the 
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60 space fields at the angles 81 through 060 are formed at 
subsequent points xxi C j_iuC tSl th^noh tl20. Thereafter, the 
formation of images for 60 space fields each is similarly repeated. 
When this is repeated 60 times, images for 3600 fields are 
projected in total. 

An example of a configuration of the deflecting plate 25 
of the three-dimensional image display apparatus will now be 
described. Fig. 14 and Fig. 15 show a configuration of the 
deflecting plate 25. As shown in those figures, the deflecting 
plate 25 is constituted of a single liquid crystal device 40. The 
surface of the deflecting plate 25 on the entrance side thereof 
is a light scattering surface 49. Therefore, light which has 
entered the deflecting plate 25 is scattered at the light 
scattering surface 49, and only light in a selected direction 
passes through and exit the liquid crystal device 40. 

In the deflecting plate 25, application of a voltage to 
stripe electrodes 44 and 45 of the liquid crystal device 40 is 
controlled such that the angle of the exiting light sequentially 
becomes 61 through 060. Fig. 14 shows an operation of the 
deflecting plate 25 when the angle of the exiting light is 01, 
and Fig. 15 shows an operation of the deflecting plate 25 when 
the angle of the exiting light is 060. As shown in those figures, 
application of a voltage to the stripe electrodes 44 and 45 of 
the liquid crystal device 40 is controlled such that the pair of 
electrodes to which the voltage is applied are sequentially 
shifted, for example, from the left side to the right side as 
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. . ^ — nair of electrodes to whxch 

between a stralgnt xme =, 

th e volta g e is applied and the plane of the deflecting plate 25. 
More specifically, voltage application scan for applying a pulse 
5 voltage to the stripe electees 45 arrant on t h e side of the 
exit surface se q uentially is performed in synchronise with 
voltage application scan for applying a pulse voltage to the stripe 
electrodes 44 arrange, on the side of the entrance surface 
sequentially at predetermined time nervals. »t this time. 
10 control is performed to maintain a horizontal offset distance 
associated with the angle 6i between a stripe electrode 44 on the 
sl de of the entrance surface to which the voltage is applied and 
. stripe electrode 45 on the side of the exit surface to which 

n.„ Such an operation is simultaneously 
the voltage is applied, such an oe 

« performed in each region associated with each pixel. 

voltage application scan for one angle 9i is performed in 
. time period of 1/3600 sec. Therefore, the time required for 
voltage application scan for all of the angles .1 through 660 is 

1/60 sec. 

20 Since the orientation of liquid crystal molecules 42 has 

ny steresis. the oriented state is maintained for a certain time 
even after the electric field moves away. Therefore, the LCD 21 

such orientation is performed throughout the deflecting plate 25 . 
26 More specifically, let us assume that a scan duty ratio defined 
as the ratio of actual time required for voltage application scan 
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/ i /^fiOO sec ) is 50% or less, for example, 
to the period of the same (= 1/3600 sec. ) is 

. . ...... rfo-Mned as the ratio of an actual 

and that a aispj-a* — 

m time to the display of the LCD 2! 1/3600 sec. ) 

is also 50% or less. Then, one cycle of voltage appilcation scan 
5 ana display of one image on the LCD 21 is performed * • 

o£ 1/36 00 sec. When matrix eiectrodes are used instead of the 
strl pe eiectrodes 44 an. 45 as described above, halftones can he 
Splayed by temporarily disturbing the direction of orientation 
of the liquid crystal molecules 42 at random and hy orienting only 
10 a part of the li^id crystal modules 42 in a region corresponding 

to one pixel at an angle 81. 

» description will no. be made with reference to Fig. 16 
on a principle behind the display position converting process in 
the present embodiment. Fig. 16 shows a schematic configuration 
15 of the three-dimensional image display apparatus of the present 
embodiment similariy to Fig. 2. In the figure, reference number 
20* represents a three-dimensionai image that is displayed when 
the display position converting process is not performed, and 

* three-dimensional image that 
reference number 20B represents a three dim 

2 „ is displayed when the display position converting process is 
performed to move the display position by a distance "a" toward 
or away from the three-dimensional image 20*. To perform such 
a position converting process, the positions of two-dimensional 
^ages for which light exits the deflecting plate 25 at an angle 
2 5 6i may be moved by a distance "b" on the defecting plate 25 in 
a direction in the plane of the two-dimensional image information. 
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that is, in the horizontal direction. n b" is a value expressed 
by Equation (2) «bnwn below. 

b = a x tanBi ... ( 2 ) 
where "a" is a negative value when the three-dimensional image 
5 is moved toward a viewer 26 and is a positive value when it is 
moved away from the viewer. 0i is a negative value when light 
exiting the deflecting plate 25 is directed to the left in Fig. 
16 and is a positive value when it is directed to the right. 
Further, "b" is a positive value when the positions of the 
10 two-dimensional images on the deflecting plate 25 are moved to 
the right in Fig. 16 and is a negative value when they are moved 
to the left. 

Therefore, the display position of the three-dimensional 
image can be moved by shifting the positions of the two-dimensional 

15 images projected on the deflecting plate 25 by "b" in accordance 
with the quantity of movement "a" of the display position of the 
three-dimensional image and the angle 0i of the light exiting the 
deflecting plate 25. The positions of the two-dimensional images 
projected on the deflecting plate 25 can be shifted by "b" by 

20 shifting the positions of the two-dimensional images on the LCD 
21 in the horizontal direction by a value obtained by multiplying 
"b" by a predetermined ratio, that is, by a value that is 
proportionate to ™b". Similar conversion is performed also in 
the vertical direction to obtain a stereoscopic image having a 

25 field angle also in the vertical direction (longitudinal 
direction) . 
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The display position converting circuit 33 in Fig. 5 and 
the display position ^unvertir.g circuit 53 in Fig. 11 perform the 
process of shifting the positions of two-dimensional images to 
convert the display position of a three-dimensional image based 
5 on the above-described principle. 

Fig. 17 is a block diagram of an example of a configuration 
of the display position converting circuits 33 and 53. It is 
assumed here that image signals input to the display position 
converting circuits 33 and 53 are digital signals. The display 
10 position converting circuits 33 and 53 have: a frame memory 61 
for storing input image signals in association with each two- 
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£g dimensional image; and a write/read address control circuit 62 



for controlling write addresses and read addresses of the frame 



q memory 61. The information of the quantity of a movement of a 

s 

q 15 display position is supplied to the write/read address control 



circuit 62 from the operating portions 34 and 54. Further, timing 
signals are supplied to the write/read address control circuit 
62 from the timing control circuits 38 and 58. 

In the display position converting circuits 33 and 53 , input 

20 image signals are written in the frame memory 61 under control 
of the write/read address control circuit 62 and are thereafter 
read and output to a subsequent stage. Then, the write/read 
address control circuit 62 finds the quantity of the positional 
shift of the two-dimensional images based on the information of 

25 the quantity of movement of the display position supplied by the 
operating portions 34 and 54 and the timing signals supplied by 
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the tuning control circuits 38 and 58. A value corresponding to 

., * in Eauation (2) is supplied as 

trie qutuiLxi-jr v^j- 

information on the quantity of a movement of the display position . 
The information of the angle 9i in Equation (2) is supplied as 
5 the timing signals. The write/read address control circuit 62 
controls write addresses and read addresses such that the 
positions of two-dimensional images represented by output image 
signals are shifted from the positions of two-dimensional images 
represented by the input image signals by the quantity thus found. 
10 The write/read address control circuit 62 corresponds to the 
quantity-of -movement calculating means of the invention, and the 
frame memory 61 and write/read address control circuit 62 
correspond to the position change means of the invention. 

When the input image signals are analog signals, they are 
15 stored in the frame memory 61 after being subjected to 
analog- to-digital conversion. 

Such a display position converting process may be performed 
by the display position converting circuit 33 in the three- 
dimensional image photographing apparatus shown in Fig. 5 or the 
20 display position converting circuit 53 in the three-dimensional 
fcnage display apparatus shown in Fig. 11. Therefore, either of 
the display position converting circuits 33 and 53 may be deleted. 

A description will now be made with reference to Fig. 18 
and Fig. 19 on an example of a method for photographing and 
25 displaying a three-dimensional image more effectively. Fig. 18 
shows a schematic configuration of a three-dimensional image 
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photographing apparatus similarly to Fig. 1, and Fig. 19 shows 
a schematic conf iguratio" nfr a three-dimensional image display 
apparatus similarly to Fig. 2 . In Fig. 18, a mirror 70 is provided 
behind an object 10 to be photographed. In this case, the rear 
5 surface of the object 10 is projected on the mirror 70. When the 
object 10 and the mirror 70 are photographed by the three- 
dimensional image photographing apparatus and the resultant 
two-dimensional image information is supplied to the three- 
dimensional image display apparatus to display a three- 
10 dimensional image, as shown in Fig. 19, a three-dimensional image 
71 of the mirror 70 is displayed behind a three-dimensional image 
20 of the object 10 in the viewing direction of a viewer 26. An 
image of the rear surface of the object 10 is projected on the 
three-dimensional image 71 of the mirror 70. As the view of the 



r % 15 three-dimensional image 20 of the object 10 changes depending on 

fee* 



the viewing direction, the view of the image of the rear surface 
of the object 10 projected on the three-dimensional image 71 of 
the mirror 70 changes depending on the viewing direction. It is 
therefore possible to achieve display of three-dimensional images 

20 with an increased stereoscopic feel compared to those available 
without the mirror 70. 

Further, it is more advantageous to render the surface of 
the deflecting plate 25 like a mirror surface by converting the 
display positions of the three-dimensional images such that the 

25 position of the mirror surface of the three-dimensional image 71 
of the mirror 70 coincides with the position of the surface of 
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the deflecting plate 25. 

As described above, according +n the three-dimensional 
image photographing apparatus and method of the present 
embodiment, the photographing direction is sequentially changed 
5 to photograph an object with the single photographing means, 
thereby acquiring a plurality of pieces of two-dimensional image 
information in different photographing directions. It is 
therefore possible to acquire image information required for 
displaying a three-dimensional image of an object in a space with 

10 a simple configuration. 

According to the three-dimensional image photographing 
apparatus and method of the present embodiment, it is possible 
to photograph an object continuously with the single 
photographing means . It is therefore possible, even if the object 

15 moves, to acquire image information required for displaying a 
three-dimensional image of the object in a space such that it moves , 
with a simple configuration. Therefore, the three-dimensional 
image photographing apparatus and method of the present 
embodiment make it possible to achieve display of a stereoscopic 

20 dynamic image in a true sense with a simple configuration. 

Further, the present embodiment makes it possible to 
convert a display position of a three-dimensional image with a 
simple configuration that is provided only by adding the display 
position converting circuits 33 and 53 and through a simple process 

25 that involves only shifting of the positions of two-dimensional 
images. It is therefore possible to display a three-dimensional 



t-j 

m 
in 

a! 

CO 

a 

Q 

□ 
yi 



52 



image in a desired position in a space. 

[ secona £iiuuumjiro** «- j 

* second embodiment of the invention will now be describee!. 
The present embodiment is an example in which an object is 
, photographed with a singie photographing means whiie the 
photographing direction is serially changed by moving the 
singie photographing means, to acquire a plurality o£ pieces of 
two-dimensional image information in different photographing 
directions . 

l0 First . a description will be made with reference to Figs . 

20 and 2! on principles behind photographing and display of a 
three-dimensional image in the present embodiment. 

Fig. 20 is an illustration showing a schematic 
configuration of a three-dimensional image photographing 

« apparatus in the present embodiment. The three-dimensional image 

*..,o in the present embodiment has: a 
photographing apparatus in the press 

converging lens 12; and a pinhole member 13. a converging lens 
14 and a CCD 15 provided in that order on the side of one surface 

• i M , 12 In the present embodiment , the pinhole 
of the converging lens iz . m me y 

• , an cii and CCD 15 are collectively referred 
20 member 13 . converging lens 14 , and CCD ar 

to as "camera 110". The camera 110 is swung in the horizontal 
taction by a camera driving device to be described later. The 
center of the swing of the camera 110 is located on an extension 
of the optical axis of the converging lens 12. 
25 in the three-dimensional image photographing apparatus, 

the surface of the converging lens 12 opposite to the pinhole 
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member 13 is directed to an object 10 to be photographed. When 
parallel uearr.s cf light perpendicularly enter the converging lens 
12 from the object 10, the converging lens 12 converges the light 
such that the exiting light will have a smallest diameter in the 
position of the pinhole of the pinhole member 13. The converging 
lens 14 forms an image of the object 10 on a photographic surface 
of the CCD 15 by converging light that has diffused after passing 
through the pinhole. 

An operation of the three-dimensional image photographing 
apparatus shown in Fig. 20 will now be described. The camera 110 
is swung in the horizontal direction. When the camera 110 is 
located at the center of the swing, only beams of light that 
perpendicularly enter the converging lens 12 form an image on CCD 
15 among the beams of light from the object 10. When the camera 
110 is not located at the center of the swing, only beams of light 
that diagonally enter the converging lens 12 at a predetermined 
angle form an image on the photographic surface of the CCD 15 among 
beams of light from the object 10. The predetermined angle 
changes depending on the position of the camera 110. 

Thus, in the three-dimensional image photographing 
apparatus shown in Fig. 20, the object 10 is photographed with 
the single photographing means (camera 110) to generate two- 
dimensional image information of the object 10, and the 
photographing direction is sequentially changed. Therefore, 
image information output by the CCD 15 is two-dimensional image 
information for which the photographing direction changes as time 
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passes and which serves as image information required for 
displaying a three -dim 0 " clonal image of the object in a space. 

Fig. 21 is an illustration showing a schematic 
configuration of a three-dimensional image display apparatus of 
the present embodiment. The three-dimensional image display 
apparatus of the present embodiment has: a transmission type LCD 
21 as a spatial light modulator that spatially modulates light 
passing therethrough based on two-dimensional image information; 
and a converging lens 22, a pinhole member 23 and a converging 
lens 24 provided in that order on the light exit side of the LCD 
21. In the present embodiment, a light source portion to be 
described later for supplying illuminating light to the LCD 21, 
the LCD 21, the converging lens 22 and the pinhole member 23 are 
collectively referred to as "projector 120". The projector 120 
is swung in the horizontal direction by a projector driving device 
to be described later. The center of the swing of the projector 
120 is located on an extension of the optical axis of the converging 
lens 24. 

The converging lens 22 converges light exiting the LCD 21 
to a minimum diameter in the position of the pinhole of the pinhole 
member 23. The converging lens 24 collimates light that has 
passed through the pinhole. 

An operation of the three-dimensional image display 
apparatus shown in Fig. 21 will now be described. The LCD 21 
spatially modulates light based on two-dimensional image 
information acquired by the three-dimensional image 
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photographing apparatus shown in Fig. 20. The light modulated 
by the LCD 21 is converged by the cor^rgina lens 22 , passes through 
the pinhole of the pinhole member 23, and exits the converging 
lens 24 after being collimated thereby. Since the projector 120 
is swung in the horizontal direction, the direction of the light 
exiting the converging lens 24 sequentially changes. The 
projector 120 is swung such that the angle of the light exiting 
the converging lens 24 coincides with the angle of incident light 
at the time of photographing. 

Thus, in the three-dimensional image display apparatus 
shown in Fig. 21, light is modulated by the LCD 21 to reproduce 
two-dimensional images based on the two-dimensional image 
information acquired by the three-dimensional image 
photographing apparatus shown in Fig. 20 for which the 
photographing direction is changed. The two-dimensional images 
are projected from the converging lens 24 at an angle that 
coincides with the angle of incident light at the time of 
photographing. As a result, a three-dimensional image 20 of the 
object 10 is formed in a space. 

The configuration of the three-dimensional image 
photographing apparatus of the present embodiment will now be 
described in detail with reference to Fig. 22. Fig. 22 is a block 
diagram of the three-dimensional image photographing apparatus 
of the present embodiment showing the configuration thereof. In 
addition to the configuration shown in Fig. 20, the three- 
dimensional image photographing apparatus has: a CCD driving 
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■ • CCD 15; a signal processing circuit 

circuit 31 for driving the CCD 

° ..... rco 15 to output image 

32 for processing signals ou^ - 

slg „als output hy the signal process circuit 32 are i P 
„ W ch performs a -play — «— « — " 
. operating portion 3, for s^ information on t h e 

converting circuit 33 , - an output circuit 3 5 for superimposi. 
station signals to the output o £ the display P o it ~ 

. lt 33 to output video signals. Further, the 
0 converting circuit 33 to ou P 

• al image photographing apparatus has: a camera 
three-dimensional image pno 

^Ing device U> tot swinging - camera UO, a camera driving 

control circuit ^3 for controlling the — — 9 «-* 

. ,» ,« tor controlling the timing 
15 112= and a tiding control circuit 38 

o£ the operation of each of the ahove-descrihed circuit, 

M operation of the three-— — 
apparatus shown in 22 -1 no„ he described. The camera 

„n vlM device 111 swing the camera 
ariving circuit 112 and camera driving dev 

„ that the photographing direction of the camera 
20 110 such that the ph ^ 

sequentially changes. The CC, driving circuit 
15 ln synchronism with the swing of the camera 110 such tha 
formation on one two-dimensional Image is acquired in eac * 
a plurality of predetermined photographing directions. Signal 

^ *v,a fiianal processing circuit 
25 outputbytheCCDlSareprocessedhythesignap 

• n, ls The image signals are sub 3 ected to the 
32 into image signals. The ima 9 
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4-.™ nrocess at the display position 
display position converting process a 

,^ mnA *r* transmitted to the output 

converting circuit jo »~ 

circuit „. The camera driving device 11X has a function of 

B focus adjustment, zooming, iens stop adjustment, shutter speed 

, ™ Those functions are controlled by the 
adjustment, and so on. Those rune 

camera control circuit 113 through the camera driving circuit 112 . 
». camera control circuit 113 transmits information on focus 
adjustment, zooming, lens stop adjustment, shutter speed 
10 adjustment, and so on to the output circuit 35 as control signals . 
Th e output circuit 35 associates the control signals with time 

The configuration of the three-dimensional image display 
app aratus in the present embodiment will now he described in detail 

„ with reference to rig. 23. » » * *»* " °* 

tM ee-dimensional image display apparatus of the present 
embodiment showing the configuration thereof . m addition to the 

<n pla 21 the three-dimensional image 
configuration shown in Fig. 21. 

alsplay apparatus has, a light source portion 50 for supplying 
» parallel beams of illuminating light to the «» 21, a 
syn chronization separation circuit 51 to which video signals are 
lnp ut and which separates synchronization signals from the video 

signal a signal processing circuit 52 for performing signal 
26 processing on the video signals output by the synchronization 
separation circuit 51 to output image signals; a display position 
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converting circuit 53 to which the signals output by the signal 
processiuy circuit 52 ^re input and which performs a display 
position converting process as needed; an operating portion 54 
for supplying information on the quantity of a movement of a 
display position to the display position converting circuit 53, 
and an LCD driving circuit 55 for driving the LCD 21 based on 
signals output by the display position converting circuit 53. 
Further, the three-dimensional image display apparatus has: a 
projector driving device 121 for driving the projector 120; a 
projector driving circuit 122 for controlling the projector 
driving device 121; a projector control circuit 123 for 
controlling the projector driving circuit 122 based on control 
signal input from the outside; and a timing control circuit 58 
to which the synchronization signals output by the 
synchronization separation circuit 51 are input and which 
controls the timing of the operation of each of the above -described 
circuits in synchronism with the synchronization signals. 

An operation of the three-dimensional image display 
apparatus shown in Fig. 23 will now be described. For example, 
video signals acquired by the three-dimensional image 
photographing apparatus shown in Fig. 22 are input to the 
three-dimensional image display apparatus. The synchronization 
separation circuit 51 separates synchronization signals from the 
input video signals and outputs the video signals and 
synchronization signals. The video signals are processed by the 
signal processing circuit 52 into image signals. The image 
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signals are subjected to the display position converting process 
at the display position converting ^-rcuit 53 as needed and 
transmitted to the LCD driving circuit 55. The LCD 21 is driven 
by the LCD driving circuit 55 based on the image signals. 
5 Parallel beams of illuminating light emitted by the light 

source portion 50 are spatially modulated by the LCD 21. As a 
result, two-dimensional images are formed. Light which has 
exited the LCD 21 passes through the converging lens 22, the 

O 

pinhole of the pinhole member 23, and the converging lens 24 to 

jfV 10 exit. 

C8 

yl The projector driving circuit 122 and the projector driving 



device 121 swing the projector 120 such that the direction of the 
light exiting the converging lens 24 sequentially changes. The 



O angle of the light exiting the converging lens 24 is controlled 

m 

0 15 such that it coincides with the angle of incident light at the 

1 * 

time of photographing with the three-dimensional image 
photographing apparatus shown in Fig. 22 for each of the two- 
dimensional images formed by the LCD 21. Such angle control is 
performed by the timing control circuit 58 based on the 

20 synchronization signals separated by the synchronization 
separation circuit 51 . The projector driving device 121 also has 
a function of driving the optical system of the projector 120 and 
so on to perform focus adjustment, zooming, lens stop adjustment, 
and so on. Those functions are controlled by the projector 

25 control circuit 123 through the projector driving circuit 122. 
The projector control circuit 123 receives information on focus 
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•no lens stop adjustment, shutter speed 
adjustment, zooming, lens sxop 

clonals from the outside, and 

adjustment, ana s«j 

performs the focus adjustment, zooming, lens stop adjustment, and 
so on of the Projector 120. hased on the control signais. This 

„ith the focus located in a position in accordance with the 

p h oto g raphin g . to ,oom the image in accordance with conditions 
for sooming at the time o £ photographing and to set the depth 
10 o £ field in accordance with conditions for lens stop advent, 
shutter speed advent, and so on at the time of 
M a result, it is possihle to display a .ore realistic 

■™,„l ima<,e When the display position converting 

three -dimensional image, mici 

process is perform, the focus information is also changed in 
16 accordance with the position after the conversion. 

«!. the camera 110 and the projector 120 are swun g in 
the horizontal direction in the present embodiment, they may he 
s™„ g in the horizontai and vertical directions ...... -ed 

t „o-dimen S ionaUy> to ohtain a stereoscopic image havin g a field 
2 „ angle also in the lon g itudlnal direction .vertical direction,. 

The conjuration, operation, and effects of the present 
sediment are otherwise the same as those of the first embodiment . 

[Third Embodiment] 

X third embodiment of the invention will now he described. 
26 ^ present embodiment is an e*ampie in which an object is 
photographed with a sin g le photo g raphin g means while the 
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pho tographing section is serially changed by .ovine a part 

. «.„ .,^it« a plurality of pieces of 

of an optical sj»^». — — 

pension*! « formation * ««— ' » 

directions . 

6 nrst . a description will be made with reference to Pigs . 

24 and 2S on principles behind photographing and display of a 
three-dimensional image in the present embodiment. 

Flg 24 is an illustration showing a schematic 
configuration of a three-dimensional image photographing 
10 apparatusofthepresentembodiment. The three-dimensional .mage 
photographing apparatus of the present embodiment has: a 
converging lens U, and a pinhole member 13. a converging lens 
M and a CCD » provided in that order on the side of one surface 

lBB , 12 in the present embodiment, the 
of the converging lens 12. in « v 

■ , M , 12 is swung in the horizontal direction by a lens 
15 converging lens 12 is swung j. 

later The center of the swing 
driving device to be described later. 

• nn lens 12 is located on an extension of the optical 
of the converging lens 

axis of the converging lens 14. 

according to the three-dimensional image photographing 
20 apparatus, an ob^ct 10 is photographed with a single 
photograph^ means to generate two-d^ensional image 
information of the ob 3 ect 10. and the converging lens 1. is swung 
in the horizontal direction to change the photographing direction 
seouentiallv. Therefore, image information output by the CC D 15 
26 is ^-dimensional ^ge information for which the photographing 
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formation re^uirea £ or aisplaving a three-dimensional — - 

the object in a space. 

Flg 25 is an illustration snowing a scheme 
figuration o £ a three-dimensional image displa, apparatus » £ 
5 the present embodiment. The three-d^nsional ^ge display 
app aratus o £ the present emboaiment has: a transmission type ,C 
21 as a spatiai light viator that spatially modulates light 
passing therethrough basea on two-aimenslonal ^ge information: 

,„a lens 22 a pinhole member 23 and a converging 
ana a converging lens a. » v 

21 In the present emboaiment. the converging lens 2, is swung 

4.- „ hv a lens driving device to be 
in the horizontal direction by a lens 

* „f the swing of the converging lens 
described later. The center of the swxng 

4- • avi q of the converging 
24 is located on an extension of the optxeal axxs 

15 lens 22. 

Accoraing to the three-aiMensional i»age aisplay apparatus . 
the ,00 2! spatially elates light basea on the two -agonal 

• a kit the three-dimensional image 
in.age information acquxred by the 

* n via 24 The light modulated 
photographing apparatus shown xn Fig. 24. 

* the converging lens 22 . passes through 
20 by the LCD 21 is converged by the converg 

lens 2, a £ ter being colled thereby. Since the converging lens 

• t„e horizontal airection. the direction of the light 
24 is swung xn the horxzontaj. 

■nn lens 24 sequentially changes. The 
exiting the convergxng lens qu 
26 converglnglen s2 ,is SW n g suchthattheangleo £ thelighte X itin, 

the converging lens 2, coincides with the angle o £ incident Ught 
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at the time of photographing. 

-~ three-dimensional image display 

THUS , a^viw* 1 ^ 

apparatus shown in Fig. 25. light is modulated by the LCD 21 to 
reproduce two-dimensional images based on two-dimensional image 

• a *«, the three-dimensional image 
5 information acquired by the 

photographing apparatus shown in Fig. 24 for which the 
photographing direction is changed. The two-dimensional images 
are projected from the converging lens 24 at an angle that 
coincides with the angle of incident light at the time of 

a« a result a three-dimensional image 20 of the 
10 photographing. As a result , a uu. 

object 10 is formed in a space. 

Fig. 26 is a block diagram of the three-dimensional image 

nresent embodiment showing the 
photographing apparatus of the present e 

configuration thereof. The three -dimensional image 

IB photographing apparatus has a lens driving device 131 for swinging 
the converging lens 12 and a lens driving circuit 132 for 
controlling the lens driving device 131. instead of the camera 
ariving device 111 and the camera driving circuit 112 of the 
tnree-dimensional image photographing apparatus shown in Fig. 22 . 
20 Further, the three-dimensional image photographing apparatus 
ha s: an adjusting portion 134 for driving the optical system and 
so on of the three-dimensional image photographing apparatus to 
perform focus adjustment, zooming, lens stop adjustment, shutter 
speed adjustment and so on ; and a camera control circuit 133 for 
25 controlling the adjusting portion 134. The camera control 
circuit 113 transmits information on focus adjustment, zooming. 
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lens stop adjustment, shutter speed adjustment and so on to the 
output cii/uuii: 33 ac cor_t™i signals. The output circuit 35 
associates the control signals with time and outputs the same along 
with video signals to the outside. 
5 Fig. 27 is a block diagram of the three-dimensional image 

display apparatus of the present embodiment showing the 
configuration thereof. The three-dimensional image display 
apparatus has a lens driving device 141 for swinging the converging 

O 

lens 24 and a lens driving circuit 142 for controlling the lens 

CO 

£fi 10 driving device 141, instead of the projector driving device 121 

CO 

and projector driving circuit 122 of the three-dimensional image 
display apparatus shown in Fig. 23. Further, the three- 
dimensional image display apparatus has: an adjusting portion 144 



I for driving the optical system and so on of the three-dimensional 

Cm 

O 15 image display apparatus to perform focus adjustment, zooming, 
lens stop adjustment, shutter speed adjustment and so on; and a 
projector control circuit 143 for controlling the adjusting 
portion 144. The projector control circuit 123 receives input 
of information on focus adjustment , zooming, lens stop adjustment , 

20 shutter speed adjustment and so on as control signals from the 
outside and performs focus adjustment, zooming, lens stop 
adjustment and so on based on the control signals. 

While the converging lenses 12 and 24 are swung in the 
horizontal direction in the present embodiment , they may be swung 

25 in the horizontal and vertical directions (e.g., moved two- 
dimensionally ) to obtain a stereoscopic image having a field angle 
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also in the longitudinal direction (vertical direction). 

Further, while the converging lenses 12 and 24 are swung 
in the horizontal direction as a part of the optical system, the 
photographing direction and the projecting direction of a 
5 two-dimensional image may be changed by moving other optical 
members . 

Fig. 28 is an illustration of an example of an optical member 
for changing the photographing direction and the projecting 

q direction of a two-dimensional image. An optical member 151 is 

si} 

n] 10 constituted of a transparent flat plate of glass or the like and 
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is swung about an axis 152 that is orthogonal to the traveling 
direction of light. Light passing through the optical member 151 
is swung in the horizontal direction depending on the position 
of the optical member 151. Therefore, the photographing 

15 direction and the projecting direction of a two-dimensional image 
can be changed by inserting the optical member 151 in the optical 
systems of the three-dimensional image photographing apparatus 
and the three-dimensional image display apparatus. 

Fig. 29 is an illustration of another example of the optical 

20 member for changing the photographing direction and the 
projecting direction of a two-dimensional image. The optical 
member has : a mirror 153 for reflecting incident light by changing 
the traveling direction thereof by 90 deg. ; a mirror 154 that is 
provided in the direction in which the light incident upon the 

25 mirror 153 travels after being reflected and that reflects 
incident light by changing the traveling direction thereof by 90 
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deg . , ana a vo.ce con .otor »5 *r reciprocate the — - 

^ reflecting surface thereof. 

in a direction perpeuux^ 

The re £1 ect 1 n g su r£ aceo t t h e^o ll5 3anat,.e r e £1 ect i „as Ul£ ace 
6 through the optica, — is — - «- ~1 airection 

.oil »otor — ™. «* Paraphing section ana the 

proj ectin g auction o £ a two-ai— 1 — ~ " *"* 
by ^ the optica, —o, in the optica! system o £ 

• i imaae photographing apparatus and the 
10 three-dimensional image pno<- y 

three-dimensional image display apparatus. 

The configuration, operation and effects of the present 
^odiment are otherwise the same as those of the second 

embodiment . 

15 [Fourth Embodiment] 

I £0 »rth —U— t o £ the invention win now he aescrihea. 
xn the present — «t. to Paraph a three-ai»ensional 
^e, a Cerent photo g raphin g section is set £ or each pixel 
to g e»erate motion o £ one two~ional - «- 

,,-v. nixel is sequentially chan g ea 
20 photographing airection £ or each pixel 

t0 generate two-a^enslonal -age motion continuous*. 
« present —ent. to aisplay a three-ai«nsional i^age. the 
two .ai»ensional i^e motion acuirea continuously as 
aescrihea ahove is pro 3 ectea £ or each pixel in a airection 
■ 26 associatea wit, the photographing airection at the «- o £ 
photographing to for- the three-ai*ensional M>. 
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rlrst a description will be made with reference « »- 
r " ». holographing direction 

t he projecting direction of each ~e 

* in the following description, a two 
embodiment . n ^ ^ „ ^ 

ta age having H P^els two . aIm enslonal 
in the vertical direction is referred to as 

. ls - Int hepresent«bodiment.itisassumed 

— 5 1Mge ln£M mation photographing means of a 

thatM o.di,en S „e ^ ^ _ 

three-dimensional image ph 

• al image information projecting means of 
") dimensional image -li 

• „ That is. a two-dimensional image 

480 pixels. That projecting 

- , There are 60 photographing and pr 
x 480 Pixels. There als x through 60 in Figs- 

*-„n S ie 61 through 860. Numerals 1 throug 
sections, i.e.. ^ ^ 660 , 

0. ^ce «~ - one three- 
up of five spa & three _ 

Lionel »age for one se. ^ ^ ^ 

M in the present embodiment, a two 

. . ls is divided into 160 sub-regions in the 
with 640 x 480 pixels is di ^ ^ 

horizontal and vertical directions. Each 

by 4 x 3 pixels . a f . f th spaoe 

Flg . 30 shows a first space field Fd 

first space frame Fm!. Regions with 4 

3 pixels in the figure rep 
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* the oixels in each sub-region are checked in their 
directions of the pxxeis m 

.„ «^4«n. in the first space field Fdl of 
order in tne sctum."** ~— 

t he first space f — «- sections of the pixel, in each 
sub -re g ion are respective* set at Si thrown 81, » - second 
. space field Pd, the sections of the pixels in each suh-re g ion 
M e respective* set at 813 throu g h 824. m tne third space field 

* fh. nixels in each sub-region are 
Fd3, the directions of the pixels 

v. ate. Tn the fourth space field 
respectively set at 625 through 836. In 

* nixels in each sub- region are 
Fd4 , the directions of the pixels 

«■ „t 837 through 648. In the fifth space field 
10 respectively set at 837 tnrougi 

* f ho nixels in each sub-region are 
Fd5. the directions of the pixels 

respectively set at 849 through 860. 

15 , 3 Pixels in the figure represent the sub-regions. When the 
sections of the pixels in each sub-region are checked in their 
order in the scanning direction, in the first space field «1 of 
the second space «. «. the directions of the pixels in each 
sub .region are respectively set at 82 through 812 and 81 . In the 

field Fd2 the directions of the pixels in each 
20 second space field fo.z, 

sub -re g ion are respectively set at 814 throu g h 824 and 813. » 
th e third space field «3. the directions of the pixels in each 
sob -re g ion are respectively set at 02. thro„ g h 83S and 825. In 
th e forth space field F d4. the directions of the pixels in each 
26 suh-re g ion are respectively set at 83, throu g h 84S and 83,. m 
t he fifth space field F d 5 . the directions of the pixels in each 
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sub-region are respectively set at 050 through 860 and 649. 

riy. 32 shc;;c z firs 1- space field Fdl through a fifth space 
field Fd5 which form a third space frame Fm3. Regions with 4 x 
3 pixels in the figure represent the sub-regions. When the 
5 directions of the pixels in each sub -region are checked in their 
order in the scanning direction, in the first space field Fdl of 
the third space frame Fm3, the directions of the pixels in each 
sub-region are respectively set at 03 through 612, 61 and 02. In 
□ the second space field Fd2 , the directions of the pixels in each 

tO 10 sub-region are respectively set at 015 through 024, 013 and 014. 

ill 

Hi In the third space field Fd3, the directions of the pixels in each 

sub-region are respectively set at 027 through 036, 025 and 026. 
In the fourth space field Fd4, the directions of the pixels in 
each sub-region are respectively set at 639 through 848, 837 and 
15 838. In the fifth space field Fd5, the directions of the pixels 
in each sub-region are respectively set at 851 through 060, 049 
and 050. 

Similarly, in each later space frame, the assignment of 
directions to pixels is shifted by one pixel in the scanning 
20 direction in each sub-region from that in the preceding frame, 
although the combination of directions assigned to each sub- 
region in the space fields Fdl through Fd5 remains unchanged. 

Fig. 33 shows a first space field Fdl through a fifth space 
field Fd5 which form a twelfth space frame Fml2. Regions with 
25 4 x 3 pixels in the figure represent the sub-regions. When the 
directions of the pixels in each sub-region are checked in their 



■a." s 



u 



# 



70 

order in the scanning direction, in the first space field Fdl of 
the twelfth cpace fr?™> Fm.1.2. the directions of the pixels in each 
sub-region are respectively set at 812 and 81 through 611. In 
the second space field Fd2, the directions of the pixels in each 
sub-region are respectively set at 824 and 813 through 623. In 
the third space field Fd3, the directions of the pixels in each 
sub-region are respectively set at 836 and 825 through 835. In 
the fourth space field Fd4, the directions of the pixels in each 
sub-region are respectively set at 848 and 837 through 647. In 
the fifth space field Fd5 # the directions of the pixels in each 
sub-region are respectively set at 860 and 849 through 659. 

In Figs. 30 through 33, in order to clearly show changes 
in the pixel to which a certain direction is assigned, the pixels 
assigned to the directions 612 , 824 , 836 , 848 , and 860 are indicated 
by enclosing them in squares. 

Figs. 34 and 35 show directions assigned to pixels in one 
sub-region. Fig. 34 shows the first space frame Fml through sixth 
space frame Fm6, and Fig. 35 shows the seventh space frame Fm7 
through twelfth space frame Fml2. 

The three-dimensional image photographing apparatus of the 
present embodiment has the same configuration as that in Fig. 5. 
In the present embodiment, the angle pattern generating circuit 
37 generates an angle pattern representing the direction of each 
pixel according to the above-described format and supplies it to 
the deflecting plate driving circuit 36. The deflecting plate 
driving circuit 36 sets an angle for incident light for each pixel 
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of the deflecting plate 11. The CCD driving circuit 31, the 
deflecting pidLe driving cl^vit 36, the angle pattern generating 
circuit 37, and the timing control circuit 38 in Fig. 5 correspond 
to the photographing control means of the invention. 
5 The three-dimensional image display apparatus of the 

present embodiment has the same configuration as that in Fig. 11. 
In the present embodiment, the angle pattern generating circuit 
57 generates an angle pattern representing the direction of each 
pixel according to the above -de scribed format and supplies it to 

10 the deflecting plate driving circuit 56. The deflecting plate 
driving circuit 56 sets an angle for exiting light for each pixel 
of the deflecting plate 25 according to the supplied angle pattern. 
The LCD driving circuit 55, the deflecting plate driving circuit 
56 , the angle pattern generating circuit 57 , and the timing control 

15 circuit 58 in Fig. 11 correspond to the display control means of 
the invention. 

The angle pattern at the time of display of each two- 
dimensional image must coincide with the angle pattern at the time 
of photographing. It can be achieved by synchronizing changes 

20 in the space frames and space fields of the two-dimensional image 
with changes in the angle pattern, based on the synchronization 
signals included in the video signals. 

As described above, in the present embodiment, a 
three-dimensional still image is formed by one space frame made 

25 up of five space fields. In one space field, still images with 
a resolution of 160 x 160 pixels are simultaneously formed in 
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twelve directions. Still images with a resolution of 160 x 160 
pixels are f ui.i»ecl in all of the directions with five space fields , 
that is, one space frame. Therefore, a three-dimensional image 
with a resolution of 160 x 160 pixels can be displayed with one 
5 space frame. Further, a three-dimensional image with a 
resolution of 640 x 480 pixels, the maximum resolution, can be 
displayed in all of the 60 directions with 12 space frames. In 
addition, a substantially perfect three-dimensional dynamic 
rj image of 60 fields/sec. can be viewed in a certain direction. 

f0 10 In the present embodiment, each space field forms images 

ff| 

it} in 12 directions among the 60 total directions, and five space 

l?I 

%ll fields (one space frame) form images in all of the 60 directions, 

a While each space frame forms a three-dimensional image with a 

resolution of 160 x 160 pixels, pixels to which a specific 

£3 

01 15 direction is assigned are different from frame to frame. As a 

□ 

result, a three-dimensional image with a resolution of 640 x 480 
pixels is formed with 12 space frames. Therefore, it may be put 
that information required for displaying a three-dimensional 
image is configured using a temporal and spatial interlacing 

20 method in the present embodiment. 

According to the present embodiment, it is possible to 
display a three-dimensional dynamic image that is worth viewing 
in terms of the cycle of image updates and resolution with the 
number of fields per second kept small. 

25 Although five space fields make up one space frame and 12 

space frames (60 space fields) form a three-dimensional image for 
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one second in the present embodiment, various modifications are 
possible as sliovr* bclov:. 

For example, four space fields may form one space frame, 
and 15 space frames (60 space fields) may form a three-dimensional 
5 image for one second. In this case, for example, a sub-region 
has 5x3 pixels, and a two-dimensional still image with a 
resolution of 128 x 160 pixels is projected in one direction in 
one space field. 

Three space fields may form one space frame, and 20 space 
10 frames (60 space fields) may form a three-dimensional image for 
one second. In this case, for example, a sub -region has 5x4 
pixels, and a two-dimensional still image with a resolution of 
128 x 120 pixels is projected in one direction in one space field. 

Two space fields may form one space frame, and 30 space 
15 frames (60 space fields) may form a three-dimensional image for 
one second. In this case, for example, a sub-region has 5x6 
pixels, and a two-dimensional still image with a resolution of 
128 x 80 pixels is projected in one direction in one space field. 

One space field may form one space frame , and 60 space frames 
20 (60 space fields ) may form a three-dimensional image for one second . 
In this case, for example, a sub-region has 10 x 6 pixels, and 
a two-dimensional still image with a resolution of 64 x 80 pixels 
is projected in one direction in one space field. 

While the number of space fields per second is 60 in the 
25 present embodiment, a three-dimensional dynamic image with 
smoother movements can be displayed by increasing the number . For 



O 

m 

m 

: =S 

U 8 

•ssr 



S 

0 

Si 

ri 

car 

cn 
□ 



74 



fnr 60 fields as described in the 

changing or cui yJ .^ *- 

present embodiment can be repeated twice in one second . which -axes 
it possible to render movements more smoothly. 
6 ^ a two-dimensional image is formed with 640 x 480 

pixels in the present embodiment, an Increase in the number of 
pixels will maxe it possible to display a more precise (finer, 
three-dimensional image. For example, let us assume that a 
two-dimensional image is formed with 1024 x 768 pixels. In this 
M case, if the space is to be divided at each predetermined angle 
ln to 60 parts to form a three-dimensional image with the 60 fields . 
a sub-region is formedwith 4 , 3 pixels to divide the image region 
of 1024 x 768 Pixels into 256 x 256 sub-regions. For example, 
cue space frame is formed by five space fields and a three- 
15 dimension* image is formed for one second by 12 space frames ,60 
space fields,. The size of the sub-region may be changed. The 

• ■ n * *. hP snace at predetermined angles may be 
number of divisions of the space az pi 

^creased to improve the spatial resolution and the field angle. 

20 It is possible to display a precise three-dimensional 

dynamic image with smooth movements if the two-dimensional images 

ls 120. in order to achieve this, the CCD and LCD must have 1024 
x ,68 pixels and must be at a rate as high as 120 fields/sec. Those 
26 recrements can be sufficiently met in view of the increasing 
number of pixels in recent CCDs and LCDs and CCD techniques adapted 
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to the non- interlace method. 

Reterriny Lu Lhe exccutio n nf a display position converting 
process in the present embodiment, after converting two- 
dimensional image information for 60 space fields having 
5 different photographing and projecting directions for each pixel 
into two-dimensional image information in each of the 60 
photographing and projecting directions, a display position 
converting process may be performed on the converted two- 
dimensional image information, and the resultant information may 

10 be converted into two-dimensional image information for 60 space 
fields having different photographing and projecting directions 
for each pixel. 

The configuration, operation, and effects of the present 
embodiment are otherwise the same as those of the first embodiment . 

15 [Fifth Embodiment] 

A fifth embodiment of the invention will now be described 
with reference to Fig. 36. The present embodiment is an example 
of an application of the invention to a television conference 
system. Fig. 36 is an illustration of a configuration of a 

20 television conference system of the present embodiment. The 
television conference system has two three-dimensional image 
photographing and display apparatuses 201 and 202. The two 
three-dimensional image photographing and display apparatuses 
201 and 202 are connected to each other through a signal 

25 transmission channel 203 for transmitting signals on a bi- 
directional basis. 
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The three-dimensional image photographing and display 
apparatuses 201 ancl 202 are p-rnvided by integrating a three- 
dimensional image photographing apparatus and a three- 
dimensional image display apparatus. In each of the three- 
dimensional image photographing and display apparatuses 201 and 
202, a half -mirror 211 is provided between the converging lens 
12 and the pinhole member 13 of the three-dimensional image 
photographing apparatus shown in Fig. 1. The half -mirror 211 is 
provided such that the normal of a reflecting surface thereof is 
at 45 degrees to the optical axis of the optical system of the 
three-dimensional image photographing apparatus. The pinhole 
member 23, the converging lens 22 and the LCD 21 of the 
three-dimensional image display apparatus are provided in the 
direction in which light from the converging lens 12 travels after 
being reflected by the half -mirror 211. Although not shown, the 
circuit configuration of the three-dimensional image 
photographing and display apparatuses 201 and 202 includes 
circuits of both of a three-dimensional image photographing 
apparatus and a three-dimensional image display apparatus. The 
three-dimensional image photographing apparatus and the 
three-dimensional image display apparatus included in the 
three-dimensional image photographing and display apparatuses 
201 and 202 may have configurations according to any of the first 
through fourth embodiments. 

An operation of the television conference system of the 
present embodiment will now be described. The three-dimensional 
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, display apparatuses 201 and 202 
ixnage photographing and display PP 

m 9 . imaaes simultaneously. 

ph otograph and display «_ _ 

Spec-ally. ^^^ 5 ^ s ^ M 

■ =i imaae information are simuii. 
for two-dimensional image « 

• n ate 11 Light which has entered the 
5 selected at the deflecting plate 11. 

.fleeting plate 11 passes through the converging lens 12. 

r 211 the pinhole member 13 and the converging lens 

through the 

• le ns 22 the pinhole member 23, the half -mirror 211 
converging lens 22 ' 

10 and the converging lens 12 to be pr 

U * the three-dimensional image 

For example, let us assume that the 

„ • and display apparatus 201 photographs an ob3ect 220 
photographing and display a Pl > 

a that the three-dimensional image Photographing an, display 

h -«t 230 The three-dimensional 
15 apparatus 202 P—s *^ »" • slgnal 

■ oio The video signals are 

-~:zz 

, 5(11 In the three-dimensional 
,0 the signal transmission channel 203. 

20 the sign two . a imensional 
^age photographing and display apparatus 

His LCD 21 based on the transmitted 
image information is formed by the LCD 21 

v ldeo signals, and the — ~ 
pro 3 eotedlndirectionsseleetedbythedeflectingplatel . - ■ 

25 lo-dimensional Image 221 of the o.eot 220 is displayed - 
L t,ee-dimensional image photographing and dispiay apparatus 
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. . ..AwnBional image photographing and 

Similarly, "«> «■"- — — 

display apparatus 202 perform signal processing on sisals 
ou tp»t by the CCD 15 to generate video signals. The video signals 
5 are transited to the three-dimensional image photographing and 
display apparatus 20! through the signal transmission channel 203 . 
m the three-dimensional image photographing and display 
apparatus 201. two-dimensional image information is formed h y the 
LCD 21 hased on the transmitted video signals, and the two- 
10 dimensions image information is projected in directions seiected 
by the deflecting plate 11. Thus, a three-dimensional image 231 
of the object 230 is displayed by the three-dimensional image 
photographing and display apparatus 201. 

«hen the objects 220 and 230 are both human-beings, the 
16 person at the three-dimensionaX image photographing and display 
apparatus 201 can vie. a three-dimensional image of the person 
at the three-dimensional image photographing and display 
apparatus 202: and the person at the three-dimensional image 
photographing and display apparatus 202 can view a three- 

« thP three-dimensional image 
20 dimensional image of the person at the three 

photographing and display apparatus 201. 

Therefore . the television conference system of the present 
sediment enables to hold a television conference with a close 
view of a three-dimensional image of each other's face. It » 
25 therefore possible to hold a teXevision conference with presence . 
Since the light entrance section of the system for photographing 
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a three-dimensional image also serves as the light exit section 
for displaying a Llizec dl^.er.s: nnai imaqe, a three-dimensional 
image of each other's face is displayed in front of the viewer. 
Therefore, the attendants can talk while looking in the eyes of 
each other, which makes it possible to hold a television conference 
with increased presence. 

A television conference can be held between three or more 
locations by installing the three-dimensional image 
photographing and display apparatus of the present embodiment in 
the three or more locations , interconnecting them through a signal 
transmission channel, and displaying video signals coming from 
other three-dimensional image photographing and display 
apparatuses by switching or synthesizing them at each three- 
dimensional image photographing and display apparatus. 

The configuration, operation, and effects of the present 
embodiment are otherwise the same as those of the first through 
fourth embodiments. 

The present invention is not limited to the above -described 
embodiments , and various modifications may be made . For example , 
image pickup devices other than CCDs may be used as the means for 
photographing two-dimensional images in the three-dimensional 
image photographing apparatuses . Display devices other than LCDs 
may be used as the means for displaying two-dimensional images 
in the three-dimensional image display apparatuses. 

The means for changing the direction of incident light in 
the three-dimensional image photographing apparatuses and 
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* naht exiting the three-dimensional 
fko direction of light exu-xny 
changing the directs . . thp 

4«.o* ^ the means used in the 

image display apparatus is - * 

JL— — — -■ £ - — Iotary p 

„ described above, according to the 

al mensio„al ~ — - M 4,16 ""'.^1 

imensional image photograph^ — - - — ' 

g _ teM o-^io n ai^ in — o £ tbeob 3 ect. : t 

» configuration ^.^sional image 

According to tne * 

+h p second three-dimensional image 
photographing apparatus or the 

photographing method - ~ t ^ 0a '- . 

,„ii«d so as to acquire two- 
alrection setting means is controlled 

■ th a low resolution that is lower 
20 aimensional image information wrth a 

. „ f the photographing means in every 

photographing direction that can be set. 

■ • n q the two-dimensional image Information rs repeatedly 

h alngpllt els to which a specific photographing 
performedwhilechangrn image 

25 direction is assigned, to a. 
information with a resolution that « 
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„„. in every photographing directions that 
of the photographing means in ev _ ^.^nsionai 

„ he set. -is is advantage^- _ ^ ^ 

ho flisolayed which is worxn v 
^ — - * ^ J ^ Msoltttlon ^ in that disp!ay 
of the cycie of image updates ^ ^ ^ 

5 of a stereoscopic dynamic »> 
„ith a simple configuration. 

forcing to the three-dimensional image *-P« » 
th e three-di,e„slonal -age display method of the invention 
• q direction setting — is -troiied to project 
the projecting directio resolutlo n that is 

i imace information with a low re 
10 ^-dH-enslonai -~ ^ ^ ^ 

iower than the resolution of he ^ 
ptoj ectingdirectionthatcanheset . 

„hile changing pixels al i^ge information with 

. . to als piay two-dimensional image in 
» is assigned, to disp ^ 

. resolution that is the same as the 

ln every projecting directions that can he 
^ans in every P^ ^ aynaBlc ^age can he 

di splayed which is worth viewi stereo scopic 
M „ p _ ana resolution and in that disP * * > ^ 

.„ a true sense can be acmeveu 
dynamic Image in a true 

configuration. converting 
The three-dimensional image display po 

or the three-dimensional image dispiay position 
W of the invention is used in a system in which 

25 converting method of the i al ^ information of an 

apl urality of pieces of two-dlmensionai im*ge 
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obj ect chained in afferent viewing directions are projected in 

. ....v. r-p fi nective viewing directions to 
directions assouxaLcu -- 

display a three-dimensional image of the object in a space. » 
^antity of a movant of a position of the two-dimensional image 
5 information in an in-piane direction regulred for moving a 
position of tne three-dimensional image by a specific quantity 
o£ movement is identified based on information on the quantity 
o£ movement of the position of tne three-dimensional image, the 
viewing directions or the projecting directions . and the position 
M of the two-dimensional image information is changed by the 
quantity of movement thus identified. As a result, it is easy 
to convert a position of the three-dimensional image of the object 

displayed in the space. 

It is apparent from the above description that the present 
15 invention can be carried out in various modes and modifications . 
^e present invention can be carried out in modes other than the 
above-described best modes for carrying out the invention within 
the scope of equivalence of the appended claims. 



